Sokrates9
/

texttest

Text Classification

Model card Files Files and versions

texttest / tokenizer_config.json

Sokrates9's picture

Create tokenizer_config.json

c2ce1f8 verified 8 months ago

history blame contribute delete

110 Bytes

	{
	"tokenizer_class": "LlamaTokenizer",
	"bos_token": "<s>",
	"eos_token": "</s>",
	"unk_token": "<unk>"
	}