File size: 99 Bytes
5fa1a76
1
If you plan on using a pretrained model, it's important to use the associated pretrained tokenizer.