mlx-community
/

SmallThinker-3B-Preview-6bit

Text Generation

text-generation-inference

Model card Files Files and versions

Felladrin commited on Feb 27

Commit

9c759ba

·

verified ·

1 Parent(s): ec4b5f2

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -11,9 +11,9 @@ tags:
 - mlx
 ---
-# Felladrin/SmallThinker-3B-Preview-Q6-mlx
-The Model [Felladrin/SmallThinker-3B-Preview-Q6-mlx](https://huggingface.co/Felladrin/SmallThinker-3B-Preview-Q6-mlx) was converted to MLX format from [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -24,7 +24,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/SmallThinker-3B-Preview-Q6-mlx")
 prompt="hello"

 - mlx
 ---
+# mlx-community/SmallThinker-3B-Preview-6bit
+The Model [mlx-community/SmallThinker-3B-Preview-6bit](https://huggingface.co/mlx-community/SmallThinker-3B-Preview-6bit) was converted to MLX format from [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/SmallThinker-3B-Preview-6bit")
 prompt="hello"