Test-18 / tokenizer.json
BICORP's picture
Upload tokenizer.json with huggingface_hub
a2452ee verified
{
"hello": 1,
"world": 2,
"hola": 3,
"mundo": 4,
"<unk>": 0
}