File size: 58 Bytes
5fa1a76
1
The LLaMA tokenizer is a BPE model based on sentencepiece.