File size: 376 Bytes
5fa1a76
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
from transformers import DataCollatorForSeq2Seq
data_collator = DataCollatorForSeq2Seq(tokenizer=tokenizer, model=checkpoint)

from transformers import DataCollatorForSeq2Seq
data_collator = DataCollatorForSeq2Seq(tokenizer=tokenizer, model=checkpoint, return_tensors="tf")

Evaluate
Including a metric during training is often helpful for evaluating your model's performance.