Spaces:

vivekkumarbarman
/

guanaco_7B

Runtime error

vivekkumarbarman commited on Jun 8, 2023

Commit

97930df

1 Parent(s): 03c641a

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -17,7 +17,7 @@ m = AutoModelForCausalLM.from_pretrained(
     torch_dtype=torch.bfloat16,
     device_map='auto'
 )
-m = PeftModel.from_pretrained(m, adapters_name)
 m = m.merge_and_unload()
 tok = LlamaTokenizer.from_pretrained(model_name)
 tok.bos_token_id = 1

     torch_dtype=torch.bfloat16,
     device_map='auto'
 )
+m = PeftModel.from_pretrained(m, adapters_name, offload_dir=offload_dir)
 m = m.merge_and_unload()
 tok = LlamaTokenizer.from_pretrained(model_name)
 tok.bos_token_id = 1