Darija-LM / tokenizer_config.json
Duino's picture
Update tokenizer_config.json
8620705 verified
{
"tokenizer_class": "PreTrainedTokenizerFast",
"model_file": "spm_model.model"
}