RTLCoder-Deepseek-v1.1 / special_tokens_map.json
ishorn5's picture
Upload tokenizer
3f10239 verified
raw
history blame contribute delete
252 Bytes
{
"additional_special_tokens": [
"<|begin▁of▁sentence|>",
"<|end▁of▁sentence|>"
],
"bos_token": "<|begin▁of▁sentence|>",
"eos_token": "<|end▁of▁sentence|>",
"pad_token": "<|end▁of▁sentence|>"
}