circulus
/

Llama-2-13b-orca-v1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

rippertnt commited on Aug 2, 2023

Commit

e77ec90

·

1 Parent(s): 76e1ab9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ pipeline_tag: text-generation
 ![img](https://huggingface.co/circulus/Llama-2-13b-orca-v1/resolve/main/llama.jpg)
 ```
-model_name = "circulus/Llama-2-13b-llava-v1"
 tokenizer = AutoTokenizer.from_pretrained(model_name, use_fast=False)
 config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_use_double_quant=True)
 model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto", quantization_config=config)

 ![img](https://huggingface.co/circulus/Llama-2-13b-orca-v1/resolve/main/llama.jpg)
 ```
+model_name = "circulus/Llama-2-13b-orca-v1"
 tokenizer = AutoTokenizer.from_pretrained(model_name, use_fast=False)
 config = BitsAndBytesConfig(load_in_4bit=True, bnb_4bit_compute_dtype=torch.bfloat16, bnb_4bit_use_double_quant=True)
 model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto", quantization_config=config)