Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ You can read more in the [official blog post](https://mistral.ai/news/codestral-
|
|
| 12 |
|
| 13 |
## Installation
|
| 14 |
|
| 15 |
-
It is recommended to use `mistralai/
|
| 16 |
|
| 17 |
|
| 18 |
```
|
|
@@ -31,10 +31,10 @@ pip install mamba_ssm causal-conv1d
|
|
| 31 |
from huggingface_hub import snapshot_download
|
| 32 |
from pathlib import Path
|
| 33 |
|
| 34 |
-
mistral_models_path = Path.home().joinpath('mistral_models', '
|
| 35 |
mistral_models_path.mkdir(parents=True, exist_ok=True)
|
| 36 |
|
| 37 |
-
snapshot_download(repo_id="mistralai/
|
| 38 |
```
|
| 39 |
|
| 40 |
### Chat
|
|
@@ -42,7 +42,7 @@ snapshot_download(repo_id="mistralai/mamba-codestral-7B-v0.1", allow_patterns=["
|
|
| 42 |
After installing `mistral_inference`, a `mistral-demo` CLI command should be available in your environment.
|
| 43 |
|
| 44 |
```
|
| 45 |
-
mistral-chat $HOME/mistral_models/
|
| 46 |
```
|
| 47 |
|
| 48 |
## Evaluation
|
|
|
|
| 12 |
|
| 13 |
## Installation
|
| 14 |
|
| 15 |
+
It is recommended to use `mistralai/Mamba-Codestral-7B-v0.1` with [mistral-inference](https://github.com/mistralai/mistral-inference)
|
| 16 |
|
| 17 |
|
| 18 |
```
|
|
|
|
| 31 |
from huggingface_hub import snapshot_download
|
| 32 |
from pathlib import Path
|
| 33 |
|
| 34 |
+
mistral_models_path = Path.home().joinpath('mistral_models', 'Mamba-Codestral-7B-v0.1')
|
| 35 |
mistral_models_path.mkdir(parents=True, exist_ok=True)
|
| 36 |
|
| 37 |
+
snapshot_download(repo_id="mistralai/Mamba-Codestral-7B-v0.1", allow_patterns=["params.json", "consolidated.safetensors", "tokenizer.model.v3"], local_dir=mistral_models_path)
|
| 38 |
```
|
| 39 |
|
| 40 |
### Chat
|
|
|
|
| 42 |
After installing `mistral_inference`, a `mistral-demo` CLI command should be available in your environment.
|
| 43 |
|
| 44 |
```
|
| 45 |
+
mistral-chat $HOME/mistral_models/Mamba-Codestral-7B-v0.1 --instruct --max_tokens 256
|
| 46 |
```
|
| 47 |
|
| 48 |
## Evaluation
|