Spaces:

Ahmadzei
/

RAG

Runtime error

App Files Files Community

RAG / chunked /nltk_chunking /main_classes_tokenizer /chunk_16.txt

Ahmadzei's picture

added 3 more tables for large emb model

5fa1a76 over 1 year ago

history blame contribute delete

93 Bytes

Take a look at the Using tokenizers from 🤗 tokenizers page to understand how this is done.