Update README.md
Browse files
README.md
CHANGED
@@ -58,17 +58,17 @@ swift sft --model huihui-ai/Llama-3.2-1B-Instruct-abliterated --model_type llama
|
|
58 |
```
|
59 |
|
60 |
|
61 |
-
4. Save the fine-tuned model.
|
62 |
Replace the directories below with specific ones.
|
63 |
|
64 |
```
|
65 |
-
swift infer --model huihui-ai/Llama-3.2-1B-Instruct-abliterated --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft/v0-20250102-153619/checkpoint-1237 --merge_lora true
|
66 |
```
|
67 |
|
68 |
|
69 |
This should create a new model directory: `checkpoint-1237-merged`, Copy or move this directory to the `huihui` directory.
|
70 |
|
71 |
-
5. Perform inference on the fine-tuned model.
|
72 |
|
73 |
```
|
74 |
swift infer --model huihui/checkpoint-1237-merged --stream true --infer_backend pt --max_new_tokens 8192
|
@@ -82,15 +82,15 @@ swift sft --model huihui-ai/checkpoint-1237-merged --model_type llama3_2 --train
|
|
82 |
```
|
83 |
|
84 |
|
85 |
-
7. Save the final fine-tuned model.
|
86 |
Replace the directories below with specific ones.
|
87 |
|
88 |
```
|
89 |
-
swift infer --model huihui-ai/checkpoint-1237-merged --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft2/v0-20250103-121319/checkpoint-
|
90 |
```
|
91 |
|
92 |
|
93 |
-
This should create a new model directory: `checkpoint-
|
94 |
|
95 |
8. Perform inference on the final fine-tuned model.
|
96 |
|
|
|
58 |
```
|
59 |
|
60 |
|
61 |
+
4. Save the fine-tuned model. After you're done, input `exit` to exit.
|
62 |
Replace the directories below with specific ones.
|
63 |
|
64 |
```
|
65 |
+
swift infer --model huihui-ai/Llama-3.2-1B-Instruct-abliterated --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft/v0-20250102-153619/checkpoint-1237 --stream true --merge_lora true
|
66 |
```
|
67 |
|
68 |
|
69 |
This should create a new model directory: `checkpoint-1237-merged`, Copy or move this directory to the `huihui` directory.
|
70 |
|
71 |
+
5. Perform inference on the fine-tuned model.
|
72 |
|
73 |
```
|
74 |
swift infer --model huihui/checkpoint-1237-merged --stream true --infer_backend pt --max_new_tokens 8192
|
|
|
82 |
```
|
83 |
|
84 |
|
85 |
+
7. Save the final fine-tuned model. After you're done, input `exit` to exit.
|
86 |
Replace the directories below with specific ones.
|
87 |
|
88 |
```
|
89 |
+
swift infer --model huihui-ai/checkpoint-1237-merged --adapters output/Llama-3.2-1B-Instruct-abliterated/lora/sft2/v0-20250103-121319/checkpoint-2474 --stream true --merge_lora true
|
90 |
```
|
91 |
|
92 |
|
93 |
+
This should create a new model directory: `checkpoint-2474-merged`, Rename the directory to `MicroThinker-1B-Preview`, Copy or move this directory to the `huihui` directory.
|
94 |
|
95 |
8. Perform inference on the final fine-tuned model.
|
96 |
|