ethicalabs
/

TowerInstruct-7B-v0.2-mlx-4Bit

4-bit precision

Model card Files Files and versions

mrs83 commited on Mar 28

Commit

b243427

·

verified ·

1 Parent(s): 8d3168f

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -19,9 +19,9 @@ tags:
 base_model: Unbabel/TowerInstruct-7B-v0.2
 ---
-# mrs83/TowerInstruct-7B-v0.2-mlx-4Bit
-The Model [mrs83/TowerInstruct-7B-v0.2-mlx-4Bit](https://huggingface.co/mrs83/TowerInstruct-7B-v0.2-mlx-4Bit) was converted to MLX format from [Unbabel/TowerInstruct-7B-v0.2](https://huggingface.co/Unbabel/TowerInstruct-7B-v0.2) using mlx-lm version **0.22.1**.
 ## Use with mlx
@@ -32,7 +32,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("mrs83/TowerInstruct-7B-v0.2-mlx-4Bit")
 prompt="hello"

 base_model: Unbabel/TowerInstruct-7B-v0.2
 ---
+# ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit
+The Model [ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit](https://huggingface.co/ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit) was converted to MLX format from [Unbabel/TowerInstruct-7B-v0.2](https://huggingface.co/Unbabel/TowerInstruct-7B-v0.2) using mlx-lm version **0.22.1**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("ethicalabs/TowerInstruct-7B-v0.2-mlx-4Bit")
 prompt="hello"