Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Corianas
/
char128_shift_tokenizer
like
0
English
License:
mit
Model card
Files
Files and versions
Community
main
char128_shift_tokenizer
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
Corianas
Update README.md
4281937
verified
1 day ago
src
Upload build_shift_char_tokenizer.py
1 day ago
.gitattributes
Safe
1.52 kB
initial commit
1 day ago
README.md
4.06 kB
Update README.md
1 day ago
special_tokens_map.json
Safe
105 Bytes
Upload 3 files
1 day ago
tokenizer.json
7.01 kB
Upload 3 files
1 day ago
tokenizer_config.json
1.01 kB
Upload 3 files
1 day ago
