Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
Tokenize the input (English) and target (French) separately because you can't tokenize French text with a tokenizer pretrained on an English vocabulary.