The LlamaTokenizer is used as it is a standard wrapper around sentencepiece.