Update README.md
Browse files
README.md
CHANGED
|
@@ -58,17 +58,17 @@ swift sft --model huihui-ai/Llama-3.2-1B-Instruct-abliterated --model_type llama
|
|
| 58 |
```
|
| 59 |
|
| 60 |
|
| 61 |
-
4. Save the fine-tuned model.
|
| 62 |
Replace the directories below with specific ones.
|
| 63 |
|
| 64 |
```
|
| 65 |
-
swift infer --model huihui-ai/Llama-3.2-1B-Instruct-abliterated --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft/v0-20250102-153619/checkpoint-1237 --merge_lora true
|
| 66 |
```
|
| 67 |
|
| 68 |
|
| 69 |
This should create a new model directory: `checkpoint-1237-merged`, Copy or move this directory to the `huihui` directory.
|
| 70 |
|
| 71 |
-
5. Perform inference on the fine-tuned model.
|
| 72 |
|
| 73 |
```
|
| 74 |
swift infer --model huihui/checkpoint-1237-merged --stream true --infer_backend pt --max_new_tokens 8192
|
|
@@ -82,15 +82,15 @@ swift sft --model huihui-ai/checkpoint-1237-merged --model_type llama3_2 --train
|
|
| 82 |
```
|
| 83 |
|
| 84 |
|
| 85 |
-
7. Save the final fine-tuned model.
|
| 86 |
Replace the directories below with specific ones.
|
| 87 |
|
| 88 |
```
|
| 89 |
-
swift infer --model huihui-ai/checkpoint-1237-merged --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft2/v0-20250103-121319/checkpoint-
|
| 90 |
```
|
| 91 |
|
| 92 |
|
| 93 |
-
This should create a new model directory: `checkpoint-
|
| 94 |
|
| 95 |
8. Perform inference on the final fine-tuned model.
|
| 96 |
|
|
|
|
| 58 |
```
|
| 59 |
|
| 60 |
|
| 61 |
+
4. Save the fine-tuned model. After you're done, input `exit` to exit.
|
| 62 |
Replace the directories below with specific ones.
|
| 63 |
|
| 64 |
```
|
| 65 |
+
swift infer --model huihui-ai/Llama-3.2-1B-Instruct-abliterated --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft/v0-20250102-153619/checkpoint-1237 --stream true --merge_lora true
|
| 66 |
```
|
| 67 |
|
| 68 |
|
| 69 |
This should create a new model directory: `checkpoint-1237-merged`, Copy or move this directory to the `huihui` directory.
|
| 70 |
|
| 71 |
+
5. Perform inference on the fine-tuned model.
|
| 72 |
|
| 73 |
```
|
| 74 |
swift infer --model huihui/checkpoint-1237-merged --stream true --infer_backend pt --max_new_tokens 8192
|
|
|
|
| 82 |
```
|
| 83 |
|
| 84 |
|
| 85 |
+
7. Save the final fine-tuned model. After you're done, input `exit` to exit.
|
| 86 |
Replace the directories below with specific ones.
|
| 87 |
|
| 88 |
```
|
| 89 |
+
swift infer --model huihui-ai/checkpoint-1237-merged --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft2/v0-20250103-121319/checkpoint-2474 --stream true --merge_lora true
|
| 90 |
```
|
| 91 |
|
| 92 |
|
| 93 |
+
This should create a new model directory: `checkpoint-2474-merged`, Rename the directory to `MicroThinker-1B-Preview`, Copy or move this directory to the `huihui` directory.
|
| 94 |
|
| 95 |
8. Perform inference on the final fine-tuned model.
|
| 96 |
|