chriscelaya commited on
Commit
251216f
·
verified ·
1 Parent(s): fb0bb76

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: unsloth/Qwen2.5-7B-bnb-4bit
3
  tags:
4
  - text-generation-inference
5
  - transformers
@@ -64,14 +64,14 @@ Install the required packages:
64
 
65
  ## Model Initialization
66
 
67
- Load the **tinyllama** model with 4-bit quantization for reduced resource usage:
68
 
69
  ```python
70
  from unsloth import FastLanguageModel
71
  import torch
72
 
73
  model, tokenizer = FastLanguageModel.from_pretrained(
74
- model_name="unsloth/Qwen2.5-7B-bnb-4bit",
75
  max_seq_length=2048,
76
  dtype=torch.bfloat16,
77
  load_in_4bit=True,
 
1
  ---
2
+ base_model: unsloth/tinyllama-bnb-4bit
3
  tags:
4
  - text-generation-inference
5
  - transformers
 
64
 
65
  ## Model Initialization
66
 
67
+ Load the **Tinyllama** model with 4-bit quantization for reduced resource usage:
68
 
69
  ```python
70
  from unsloth import FastLanguageModel
71
  import torch
72
 
73
  model, tokenizer = FastLanguageModel.from_pretrained(
74
+ model_name="unsloth/tinyllama-bnb-4bit",
75
  max_seq_length=2048,
76
  dtype=torch.bfloat16,
77
  load_in_4bit=True,