Commit
·
99db378
1
Parent(s):
8f2cba5
Remove WD folder when done
Browse filesand added info to instructions
exl2-windows-local/convert-model-auto.bat
CHANGED
@@ -5,4 +5,5 @@ set /p "bpw=Target BPW: "
|
|
5 |
mkdir %model%-exl2-%bpw%bpw
|
6 |
mkdir %model%-exl2-%bpw%bpw-WD
|
7 |
copy %model%\config.json %model%-exl2-%bpw%bpw-WD
|
8 |
-
venv\scripts\python.exe convert.py -i %model% -o %model%-exl2-%bpw%bpw-WD -cf %model%-exl2-%bpw%bpw -b %bpw%
|
|
|
|
5 |
mkdir %model%-exl2-%bpw%bpw
|
6 |
mkdir %model%-exl2-%bpw%bpw-WD
|
7 |
copy %model%\config.json %model%-exl2-%bpw%bpw-WD
|
8 |
+
venv\scripts\python.exe convert.py -i %model% -o %model%-exl2-%bpw%bpw-WD -cf %model%-exl2-%bpw%bpw -b %bpw%
|
9 |
+
rmdir /s /q %model%-exl2-%bpw%-WD
|
exl2-windows-local/instructions.txt
CHANGED
@@ -10,4 +10,6 @@ Haven't done much testing but Visual Studio with desktop development for C++ mig
|
|
10 |
|
11 |
make sure you setup the environment by using windows-setup.bat
|
12 |
after everything is done just download a model using download-model.bat
|
13 |
-
to quant, use convert-model-auto.bat. Enter the model's folder name, then the BPW for the model
|
|
|
|
|
|
10 |
|
11 |
make sure you setup the environment by using windows-setup.bat
|
12 |
after everything is done just download a model using download-model.bat
|
13 |
+
to quant, use convert-model-auto.bat. Enter the model's folder name, then the BPW for the model
|
14 |
+
|
15 |
+
You can always pause the quantization process by pressing Ctrl + C and typing exit. All progress will be stored in the WD (working directory) folder. You can resume where you left off by running the convert-model-auto.bat script with the same arguments you used before.
|