Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

aloobun
/
IN-Llama-3-Tokenizer

Transformers
llama
tokenizer
bpe
Indic
Model card Files Files and versions
xet
Community
IN-Llama-3-Tokenizer / model
Ctrl+K
Ctrl+K
  • 1 contributor
History: 1 commit
aloobun's picture
aloobun
Upload 2 files
ade8085 verified 9 months ago
  • tokenizer.model
    1.88 MB
    xet
    Upload 2 files 9 months ago
  • tokenizer.vocab
    1.57 MB
    Upload 2 files 9 months ago