AlejandroOlmedo
/

OpenThinker-32B-8bit-mlx

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

AlejandroOlmedo commited on 8 days ago

Commit

20e7301

·

verified ·

1 Parent(s): 0e81e1a

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -32,13 +32,13 @@ model-index:
 ## Other Types:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
-| [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-32B-8bit-mlx) | 8-bit | 34.80 GB | **Best Quality** |
-| [MLX] (https://huggingface.co/Alejandroolmedo/OpenThinker-32B-4bit-mlx) | 4-bit | 18.40 GB | Good Quality|
-# Alejandroolmedo/OpenThinker-32B-8bit-mlx
-The Model [Alejandroolmedo/OpenThinker-32B-8bit-mlx](https://huggingface.co/Alejandroolmedo/OpenThinker-32B-8bit-mlx) was converted to MLX format from [open-thoughts/OpenThinker-32B](https://huggingface.co/open-thoughts/OpenThinker-32B) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -49,7 +49,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Alejandroolmedo/OpenThinker-32B-8bit-mlx")
 prompt="hello"

 ## Other Types:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
+| [MLX] (https://huggingface.co/AlejandroOlmedo/OpenThinker-32B-8bit-mlx) | 8-bit | 34.80 GB | **Best Quality** |
+| [MLX] (https://huggingface.co/AlejandroOlmedo/OpenThinker-32B-4bit-mlx) | 4-bit | 18.40 GB | Good Quality|
+# AlejandroOlmedo/OpenThinker-32B-8bit-mlx
+The Model [AlejandroOlmedo/OpenThinker-32B-8bit-mlx](https://huggingface.co/AlejandroOlmedo/OpenThinker-32B-8bit-mlx) was converted to MLX format from [open-thoughts/OpenThinker-32B](https://huggingface.co/open-thoughts/OpenThinker-32B) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("AlejandroOlmedo/OpenThinker-32B-8bit-mlx")
 prompt="hello"