maxrubin629
/

DeepHermes-3-Llama-3-8B-Preview-6bit

Model card Files Files and versions Community

maxrubin629 commited on 6 days ago

Commit

baf9137

·

verified ·

1 Parent(s): 2b4d7df

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -35,9 +35,9 @@ model-index:
   results: []
 ---
-# maxrubin629/DeepHermes-3-Llama-3-8B-Preview-Q6-mlx
-The Model [maxrubin629/DeepHermes-3-Llama-3-8B-Preview-Q6-mlx](https://huggingface.co/maxrubin629/DeepHermes-3-Llama-3-8B-Preview-Q6-mlx) was converted to MLX format from [NousResearch/DeepHermes-3-Llama-3-8B-Preview](https://huggingface.co/NousResearch/DeepHermes-3-Llama-3-8B-Preview) using mlx-lm version **0.20.5**.
 ## Use with mlx
@@ -48,7 +48,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("maxrubin629/DeepHermes-3-Llama-3-8B-Preview-Q6-mlx")
 prompt="hello"

   results: []
 ---
+# maxrubin629/DeepHermes-3-Llama-3-8B-Preview-6bit
+The Model [maxrubin629/DeepHermes-3-Llama-3-8B-Preview-6bit](https://huggingface.co/maxrubin629/DeepHermes-3-Llama-3-8B-Preview-6bit) was converted to MLX format from [NousResearch/DeepHermes-3-Llama-3-8B-Preview](https://huggingface.co/NousResearch/DeepHermes-3-Llama-3-8B-Preview) using mlx-lm version **0.20.5**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("maxrubin629/DeepHermes-3-Llama-3-8B-Preview-6bit")
 prompt="hello"