Darija-LM / tokenizer_config.json
Duino's picture
Update tokenizer_config.json
8620705 verified
raw
history blame
90 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast",
"model_file": "spm_model.model"
}