Hugging Face's logo

Spaces:
biodatlab
/
NBDT-Recommendation-Engine
Runtime error

App Files Community
atrytone commited on
Commit
32e3ff2
·
1 Parent(s): 694cdd3

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -0
app.py CHANGED
@@ -14,6 +14,7 @@ tokenizer = LlamaTokenizer.from_pretrained("samwit/koala-7b")
14
  base_model = LlamaForCausalLM.from_pretrained(
15
  "samwit/koala-7b",
16
  load_in_8bit=True,
 
17
  device_map='auto',
18
  )
19
 
 
14
  base_model = LlamaForCausalLM.from_pretrained(
15
  "samwit/koala-7b",
16
  load_in_8bit=True,
17
+ device='cpu',
18
  device_map='auto',
19
  )
20