|
--- |
|
license: apache-2.0 |
|
tags: |
|
- generated_from_trainer |
|
base_model: mistralai/Mistral-7B-Instruct-v0.1 |
|
model-index: |
|
- name: fiveflow/ATOMM-v0.18 |
|
results: [] |
|
language: |
|
- ko |
|
--- |
|
|
|
How to use |
|
|
|
```Python |
|
from transformers import AutoModelForCausalLM, AutoTokenizer, TextGenerationPipeline |
|
model_path = 'fiveflow/ATOMM' |
|
tokenizer = AutoTokenizer.from_pretrained(model_path) |
|
model = AutoModelForCausalLM.from_pretrained(model_path, |
|
device_map="auto", |
|
# load_in_4bit=True, |
|
low_cpu_mem_usage=True) |
|
|
|
pipe = TextGenerationPipeline(model = model, tokenizer = tokenizer) |
|
``` |
