distilgpt2-finetuned-wikitext2-n0409n / special_tokens_map.json
ntust0's picture
Upload tokenizer
9e80c36 verified
raw
history blame
99 Bytes
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}