File size: 3,132 Bytes
ea36a5b 546312e ea36a5b 6f40bad |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 |
LoRA which is fine-tuned for "command" following.
### How to use?
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, BitsAndBytesConfig
model_id = "EleutherAI/pythia-2.8b-deduped"
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_use_double_quant=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.bfloat16
)
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config, device_map={"":0})
# load adapter
if True:
from peft import PeftModel
model = PeftModel.from_pretrained(
model, "Q4234/commandA-LoRA-2.8b",
torch_dtype=torch.float16
)
### Prompting
Assistant can use any tools he likes by calling the tool as python functions.
ex:
var=google('what is life?') - to search for something using google and write the result as a string into variable var
result0=calc('5 + 6') - to compute something using a calculator and put the result into the variable result0
ubuntuShell('ls -lah') - to execute command 'ls -lah' in the shell under linux ubuntu
appendToFile(<filename>, <content>) - to append(write) string <content> to file <filename>
str5 = """AB c 7""" - to assign variable str5 to "AB c 7"
Human: Your goal is to install qemu, virtualbox and update pytorch. Tell me all the steps your doing to accomplish the goal!
Assistant:
it can also answer questions quite nicely
Q: What is 1+2? A: The answer is 3.\nQ: What is a cat? A: A cat is an animal.\nQ: Who is Bill Gates? A: Bill Gates is the creator of Microsoft.\nQ: What is an agent? Explain! A: An agent is a person that is able to make choices for another person.\nQ: What is 4+9?\nA: 13\nQ: Who is George Washington and what is the meaning of life?\nA:"
gives
A: George Washington was the first president of the United States. The meaning of life is that human life has value and purpose.
Q: What is the goal of a human life?
A: To live a long and healthy life and achieve happiness.
Q: Who are the different types of cancers? A: There are two main types of cancers. One is cancer that can develop into a death sentence for the patient. The other type is a more common cancer that can be cured with surgery, radiation, and chemotherapy.
Q: What is cancer? A: Cancer is a disease that can develop into a death sentence for the patient.
Q: What is a gene? Explain! A: A gene is the part of DNA that contains the information needed to create a protein.
Q: What is a protein? Explain! A: A protein is the molecular structure of an organism. It performs functions that are needed for growth and development.
Q: How do genes code information?
A: Genes code information in DNA. DNA is a molecule composed of the letters A, C, T, and G, which stand for the letters adenine, cytosine, thymine, and guanine. A gene codes information
### issues
* command outputs are suboptimal, should get fixed with later better models.
---
license: mit
---
|