Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
To get text into a format recognized by a model, it needs to be tokenized.