Spaces:

vivekkumarbarman
/

guanaco_7B

Runtime error

vivekkumarbarman commited on Jun 8, 2023

Commit

03c641a

1 Parent(s): 5949331

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -15,8 +15,7 @@ m = AutoModelForCausalLM.from_pretrained(
     model_name,
     #load_in_4bit=True,
     torch_dtype=torch.bfloat16,
-    device_map='auto',
-    use_ram_optimized_load=False
 )
 m = PeftModel.from_pretrained(m, adapters_name)
 m = m.merge_and_unload()

     model_name,
     #load_in_4bit=True,
     torch_dtype=torch.bfloat16,
+    device_map='auto'
 )
 m = PeftModel.from_pretrained(m, adapters_name)
 m = m.merge_and_unload()