Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
While it is possible to pad your text in the tokenizer function by setting padding=True, dynamic padding is more efficient.