Spaces:

jdelavande
/

chat-ui-energy

Running on CPU Upgrade

nsarrazin commited on Jun 28, 2024

Commit

fcdb3b3

unverified ·

1 Parent(s): 71ca905

Sampling parameters gemma 2

Files changed (1) hide show

chart/env/prod.yaml CHANGED Viewed

@@ -101,8 +101,9 @@ envVars:
         "parameters": {
           "truncate" : 6146,
           "max_new_tokens" : 2044,
-          "temperature": 0.1,
-          "stop" : ["<end_of_turn>"]
         },
         "preprompt" : "",
         "promptExamples" : [

         "parameters": {
           "truncate" : 6146,
           "max_new_tokens" : 2044,
+          "temperature": 0.95,
+          "top_k": 100,
+          "stop" : ["<end_of_turn>", "<eos>", "<end_of_turn><eos>"]
         },
         "preprompt" : "",
         "promptExamples" : [