Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
selftok-team
/
SelftokTokenizer
like
2
arxiv:
2505.07538
arxiv:
2504.14666
Model card
Files
Files and versions
xet
Community
main
SelftokTokenizer
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
selftok-team
Update README.md
a3ee3c2
verified
3 months ago
.gitattributes
Safe
1.52 kB
initial commit
4 months ago
README.md
10.4 kB
Update README.md
3 months ago
renderer_1024_ckpt.pth
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
What is a pickle import?
9.05 GB
xet
Upload renderer_1024_ckpt.pth
4 months ago
renderer_512_ckpt.pth
pickle
Detected Pickle imports (3)
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
What is a pickle import?
8.98 GB
xet
Upload renderer_512_ckpt.pth
4 months ago
tokenizer_1024_ckpt.pth
pickle
Detected Pickle imports (3)
"torch.FloatStorage"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
What is a pickle import?
9.05 GB
xet
Upload tokenizer_1024_ckpt.pth
4 months ago
tokenizer_512_ckpt.pth
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
What is a pickle import?
8.98 GB
xet
Upload tokenizer_512_ckpt.pth
4 months ago