reasonwang commited on
Commit
6a71ed4
·
1 Parent(s): fd49386

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -1,3 +1,16 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ Usage:
5
+
6
+ ```python
7
+ import transformers
8
+ from peft import PeftModel
9
+
10
+ base_model = transformers.AutoModelForSeq2SeqLM.from_pretrained("google/flan-t5-base")
11
+ peft_model = PeftModel.from_pretrained(base_model,"reasonwang/flan-alpaca-lora-base")
12
+
13
+ inputs = tokenizer("Write an email to a boy whose parent passed away:", return_tensors="pt")
14
+ outputs = peft_model.generate(**inputs, max_length=128, do_sample=True)
15
+ print(tokenizer.batch_decode(outputs, skip_special_tokens=True))
16
+ ```