Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
By default, the VitsTokenizer normalizes the inputs by removing any casing and punctuation, to avoid passing out-of-vocabulary characters to the model.