S1M0N38 commited on
Commit
6a72ce4
·
verified ·
1 Parent(s): 0e98026

Create generation_config.json

Browse files

As suggested by the author of the qwq32, these are the suggested config that should be used for the token generation.

Files changed (1) hide show
  1. generation_config.json +14 -0
generation_config.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 151643,
3
+ "do_sample": true,
4
+ "eos_token_id": [
5
+ 151645,
6
+ 151643
7
+ ],
8
+ "pad_token_id": 151643,
9
+ "repetition_penalty": 1.0,
10
+ "temperature": 0.6,
11
+ "top_k": 40,
12
+ "top_p": 0.95,
13
+ "transformers_version": "4.45.2"
14
+ }