Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
from transformers import DefaultDataCollator
data_collator = DefaultDataCollator()
To avoid overfitting and to make the model more robust, add some data augmentation to the training part of the dataset.