vien-unigram-tokenizer / added_tokens.json
Le Vu Loi
add necessary assets
8a91069
raw
history blame contribute delete
99 Bytes
{
"</s>": 2,
"<cls>": 5,
"<mask>": 4,
"<pad>": 3,
"<s>": 1,
"<sep>": 6,
"<unk>": 0
}