llama-op-v17 / added_tokens.json
anhnv125's picture
Upload tokenizer
262d58c
raw
history blame contribute delete
49 Bytes
{
"<pad>": 32000,
"<|end_of_turn|>": 32001
}