Spaces:

ccm
/

chat-with-SFF

Runtime error

ccm commited on Nov 8, 2024

Commit

1d2dff9

verified ·

1 Parent(s): 0eaf91a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -76,6 +76,8 @@ llm = llama_cpp.Llama.from_pretrained(
     filename="Qwen2.5-7B-Instruct-Q4_K_M.gguf",
     n_gpu_layers=-1,
     n_ctx=2048,
 )

     filename="Qwen2.5-7B-Instruct-Q4_K_M.gguf",
     n_gpu_layers=-1,
     n_ctx=2048,
+    n_threads=1,
+    verbose=True
 )