update docs [skip ci] (#1176)
Browse files
README.md
CHANGED
|
@@ -1,6 +1,3 @@
|
|
| 1 |
-
## What's New
|
| 2 |
-
- Added `Mistral-7b-example`: A comprehensive example for fine-tuning Mistral-7b model. [Check it out here](https://github.com/Tilemachoc/axolotl/tree/mistral-7b-example/examples/mistral/Mistral-7b-example).
|
| 3 |
-
|
| 4 |
# Axolotl
|
| 5 |
|
| 6 |
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
|
|
@@ -108,6 +105,9 @@ pip3 install -e '.[flash-attn,deepspeed]'
|
|
| 108 |
|
| 109 |
### Usage
|
| 110 |
```bash
|
|
|
|
|
|
|
|
|
|
| 111 |
# finetune lora
|
| 112 |
accelerate launch -m axolotl.cli.train examples/openllama-3b/lora.yml
|
| 113 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Axolotl
|
| 2 |
|
| 3 |
Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures.
|
|
|
|
| 105 |
|
| 106 |
### Usage
|
| 107 |
```bash
|
| 108 |
+
# preprocess datasets - optional but recommended
|
| 109 |
+
CUDA_VISIBLE_DEVICES="" python -m axolotl.cli.preprocess examples/openllama-3b/lora.yml
|
| 110 |
+
|
| 111 |
# finetune lora
|
| 112 |
accelerate launch -m axolotl.cli.train examples/openllama-3b/lora.yml
|
| 113 |
|