kernelpool commited on
Commit
da02792
·
verified ·
1 Parent(s): 34ffadc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,7 +1,34 @@
1
  ---
2
- language: en
3
- tags:
4
- - mlx
5
  pipeline_tag: text-generation
 
6
  library_name: mlx
 
 
 
7
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
 
2
  pipeline_tag: text-generation
3
+ license: mit
4
  library_name: mlx
5
+ base_model: MiniMaxAI/MiniMax-M2
6
+ tags:
7
+ - mlx
8
  ---
9
+
10
+ # catalystsec/MiniMax-M2-3bit-DWQ
11
+
12
+ This model was quantized to 3-bit using DWQ with mlx-lm version **0.28.4**.
13
+
14
+ ## Use with mlx
15
+
16
+ ```bash
17
+ pip install mlx-lm
18
+ ```
19
+
20
+ ```python
21
+ from mlx_lm import load, generate
22
+
23
+ model, tokenizer = load("catalystsec/MiniMax-M2-3bit-DWQ")
24
+
25
+ prompt = "hello"
26
+
27
+ if tokenizer.chat_template is not None:
28
+ messages = [{"role": "user", "content": prompt}]
29
+ prompt = tokenizer.apply_chat_template(
30
+ messages, add_generation_prompt=True
31
+ )
32
+
33
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
34
+ ```