mistral-ko-llm / added_tokens.json
sronger's picture
Upload tokenizer
f307766
raw
history blame contribute delete
66 Bytes
{
"\n": 32002,
"<|im_end|>": 32000,
"<|im_start|>": 32001
}