kashif-2b-instruct-rag-playground

Running on Zero

karimouda commited on Jan 30

Commit

cf713c5

verified ·

1 Parent(s): e8abdc9

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -54,7 +54,8 @@ def generate(
         streamer=streamer,
         max_new_tokens=max_new_tokens,
         do_sample=True,
-        temperature=temperature
     )
     t = Thread(target=model.generate, kwargs=generate_kwargs)
     t.start()

         streamer=streamer,
         max_new_tokens=max_new_tokens,
         do_sample=True,
+        temperature=temperature,
+        num_beams=1,
     )
     t = Thread(target=model.generate, kwargs=generate_kwargs)
     t.start()