Merge pull request #118 from NanoCode012/feat/torch-readme
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@
|
|
| 27 |
|
| 28 |
## Quickstart ⚡
|
| 29 |
|
| 30 |
-
**Requirements**: Python 3.9.
|
| 31 |
|
| 32 |
```bash
|
| 33 |
git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
|
@@ -58,7 +58,9 @@ accelerate launch scripts/finetune.py examples/lora-openllama-3b/config.yml \
|
|
| 58 |
- Conda/Pip venv
|
| 59 |
1. Install python **3.9**
|
| 60 |
|
| 61 |
-
2. Install
|
|
|
|
|
|
|
| 62 |
- `pip3 install -e .` (recommended, supports QLoRA, no gptq/int4 support)
|
| 63 |
- `pip3 install -e .[gptq]` (next best if you don't need QLoRA, but want to use gptq)
|
| 64 |
- `pip3 install -e .[gptq_triton]`
|
|
|
|
| 27 |
|
| 28 |
## Quickstart ⚡
|
| 29 |
|
| 30 |
+
**Requirements**: Python 3.9 and Pytorch 2.0.
|
| 31 |
|
| 32 |
```bash
|
| 33 |
git clone https://github.com/OpenAccess-AI-Collective/axolotl
|
|
|
|
| 58 |
- Conda/Pip venv
|
| 59 |
1. Install python **3.9**
|
| 60 |
|
| 61 |
+
2. Install pytorch stable https://pytorch.org/get-started/locally/
|
| 62 |
+
|
| 63 |
+
3. Install python dependencies with ONE of the following:
|
| 64 |
- `pip3 install -e .` (recommended, supports QLoRA, no gptq/int4 support)
|
| 65 |
- `pip3 install -e .[gptq]` (next best if you don't need QLoRA, but want to use gptq)
|
| 66 |
- `pip3 install -e .[gptq_triton]`
|