AlejandroOlmedo
/

DeepScaleR-1.5B-Preview-4bit-mlx

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

AlejandroOlmedo commited on 7 days ago

Commit

dcf515c

·

verified ·

1 Parent(s): 91384d9

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -29,15 +29,15 @@ https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview. (Base Model)
 # Other Types/Sizes:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
-| [MLX] (https://huggingface.co/Alejandroolmedo/DeepScaleR-1.5B-Preview-8bit-mlx) | 8-bit | 1.90 GB | **Best Quality** |
-| [MLX] (https://huggingface.co/Alejandroolmedo/DeepScaleR-1.5B-Preview-6bit-mlx) | 6-bit | 1.46 GB | Better Quality|
-| [MLX] (https://huggingface.co/Alejandroolmedo/DeepScaleR-1.5B-Preview-4bit-mlx) | 4-bit | 1.01 GB | Good Quality|
 I simply converted it to MLX format with a quantization of 4-bits for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
-# Alejandroolmedo/DeepScaleR-1.5B-Preview-4bit-mlx
-The Model [Alejandroolmedo/DeepScaleR-1.5B-Preview-4bit-mlx](https://huggingface.co/Alejandroolmedo/DeepScaleR-1.5B-Preview-4bit-mlx) was converted to MLX format from [agentica-org/DeepScaleR-1.5B-Preview](https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -48,7 +48,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Alejandroolmedo/DeepScaleR-1.5B-Preview-4bit-mlx")
 prompt="hello"

 # Other Types/Sizes:
 | Link | Type | Size| Notes |
 |-------|-----------|-----------|-----------|
+| [MLX] (https://huggingface.co/AlejandroOlmedo/DeepScaleR-1.5B-Preview-8bit-mlx) | 8-bit | 1.90 GB | **Best Quality** |
+| [MLX] (https://huggingface.co/AlejandroOlmedo/DeepScaleR-1.5B-Preview-6bit-mlx) | 6-bit | 1.46 GB | Better Quality|
+| [MLX] (https://huggingface.co/AlejandroOlmedo/DeepScaleR-1.5B-Preview-4bit-mlx) | 4-bit | 1.01 GB | Good Quality|
 I simply converted it to MLX format with a quantization of 4-bits for better performance on Apple Silicon Macs (M1,M2,M3,M4 Chips).
+# AlejandroOlmedo/DeepScaleR-1.5B-Preview-4bit-mlx
+The Model [AlejandroOlmedo/DeepScaleR-1.5B-Preview-4bit-mlx](https://huggingface.co/AlejandroOlmedo/DeepScaleR-1.5B-Preview-4bit-mlx) was converted to MLX format from [agentica-org/DeepScaleR-1.5B-Preview](https://huggingface.co/agentica-org/DeepScaleR-1.5B-Preview) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("AlejandroOlmedo/DeepScaleR-1.5B-Preview-4bit-mlx")
 prompt="hello"