Mr-Vicky-01
/

nl-pgsql-248M

Text2Text Generation

Model card Files Files and versions Community

Mr-Vicky-01 commited on Sep 27, 2024

Commit

b69dbe2

·

verified ·

1 Parent(s): fc953bb

Upload tokenizer

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -836,7 +836,7 @@
   "additional_special_tokens": [
     "<"
   ],
-  "clean_up_tokenization_spaces": true,
   "eos_token": "</s>",
   "extra_ids": 100,
   "model_max_length": 512,

   "additional_special_tokens": [
     "<"
   ],
+  "clean_up_tokenization_spaces": false,
   "eos_token": "</s>",
   "extra_ids": 100,
   "model_max_length": 512,