Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
tokenizer = processor.tokenizer
On top of the preprocessing mentioned above, we also need to add the labels for the model.