Kukedlc commited on
Commit
b0aa15d
·
verified ·
1 Parent(s): b831b80

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -25
README.md CHANGED
@@ -49,28 +49,3 @@ parameters:
49
  int8_mask: true
50
  dtype: float16
51
  ```
52
-
53
- ## 💻 Usage
54
-
55
- ```python
56
- !pip install -qU transformers accelerate
57
-
58
- from transformers import AutoTokenizer
59
- import transformers
60
- import torch
61
-
62
- model = "Kukedlc/Neural-Cosmic-Boy-7B-slerp"
63
- messages = [{"role": "user", "content": "What is a large language model?"}]
64
-
65
- tokenizer = AutoTokenizer.from_pretrained(model)
66
- prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
67
- pipeline = transformers.pipeline(
68
- "text-generation",
69
- model=model,
70
- torch_dtype=torch.float16,
71
- device_map="auto",
72
- )
73
-
74
- outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
75
- print(outputs[0]["generated_text"])
76
- ```
 
49
  int8_mask: true
50
  dtype: float16
51
  ```