FoundationVision
/

unitok_tokenizer

Feature Extraction

Model card Files Files and versions Community

unitok_tokenizer

Ctrl+K

Ctrl+K

3 contributors

History: 8 commits

machuofan's picture

Upload unitok_tokenizer.pth with huggingface_hub

7f6ea34 verified 22 days ago

.gitattributes

1.52 kB

initial commit about 2 months ago
README.md

3.62 kB

Update README.md about 2 months ago
config.json

2.79 kB

update readme about 2 months ago
unitok_tokenizer.pth
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.bfloat16",
- "torch.FloatStorage",
- "collections.OrderedDict"
How to fix it?
3.31 GB
LFS

Upload unitok_tokenizer.pth with huggingface_hub 22 days ago