laituanmanh32
/

vietnamese-embedding-onnx

Sentence Similarity

sentence-transformers

feature-extraction

sentence-embedding

text-embeddings-inference

Model card Files Files and versions

Manh Lai commited on Apr 1

Commit

5951eec

·

1 Parent(s): a2e8df7

fix: tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -1

tokenizer_config.json CHANGED Viewed

@@ -45,10 +45,11 @@
   "clean_up_tokenization_spaces": true,
   "cls_token": "<s>",
   "eos_token": "</s>",
   "mask_token": "<mask>",
   "model_max_length": 512,
   "pad_token": "<pad>",
   "sep_token": "</s>",
   "tokenizer_class": "PhobertTokenizer",
   "unk_token": "<unk>"
-}

   "clean_up_tokenization_spaces": true,
   "cls_token": "<s>",
   "eos_token": "</s>",
+  "extra_special_tokens": {},
   "mask_token": "<mask>",
   "model_max_length": 512,
   "pad_token": "<pad>",
   "sep_token": "</s>",
   "tokenizer_class": "PhobertTokenizer",
   "unk_token": "<unk>"
+}