Spaces:

dgjx
/

llama-3-sqlcoder-8b

Sleeping

dgjx commited on Sep 15, 2024

Commit

3a05353

verified ·

1 Parent(s): 08343a9

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,7 @@ The following SQL query best answers the question `{user_question}`:
 ```sql
 """
-    inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
     generated_ids = model.generate(
         **inputs,
         num_return_sequences=1,

 ```sql
 """
+    inputs = tokenizer(prompt, return_tensors="pt").to("cuda" if torch.cuda.is_available() else "cpu")
     generated_ids = model.generate(
         **inputs,
         num_return_sequences=1,