Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
It is very important to find/extract the original tokenizer file and to manage to load this file into the 🤗
Transformers' implementation of the tokenizer.