from transformers import DataCollatorForSeq2Seq | |
data_collator = DataCollatorForSeq2Seq(tokenizer=tokenizer, model=checkpoint) | |
from transformers import DataCollatorForSeq2Seq | |
data_collator = DataCollatorForSeq2Seq(tokenizer=tokenizer, model=checkpoint, return_tensors="tf") | |
Evaluate | |
Including a metric during training is often helpful for evaluating your model's performance. |