mlabonne pcuenq HF Staff commited on
Commit
e3facd4
·
verified ·
1 Parent(s): 0a9ce37

Fix expected model inputs (#6)

Browse files

- Fix expected model inputs (b1945925cdaf2d931eae0c94de41aae4d1e7ad06)


Co-authored-by: Pedro Cuenca <[email protected]>

Files changed (1) hide show
  1. tokenizer_config.json +1 -0
tokenizer_config.json CHANGED
@@ -4064,6 +4064,7 @@
4064
  "eos_token": "<|im_end|>",
4065
  "extra_special_tokens": {},
4066
  "legacy": false,
 
4067
  "model_max_length": 1000000000000000019884624838656,
4068
  "pad_token": "<|pad|>",
4069
  "sp_model_kwargs": {},
 
4064
  "eos_token": "<|im_end|>",
4065
  "extra_special_tokens": {},
4066
  "legacy": false,
4067
+ "model_input_names": ["input_ids", "attention_mask"],
4068
  "model_max_length": 1000000000000000019884624838656,
4069
  "pad_token": "<|pad|>",
4070
  "sp_model_kwargs": {},