HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8
Updated
•
9
meta-llama/Llama-3.2-1B Quantized
Find the quantized versions of Llama-3.2-1B all in one place
-
-
HF-Quantization/Llama-3.2-1B-BNB-INT8
Updated • 22 -
HF-Quantization/Llama-3.2-1B-BNB-NF4
Updated • 27 -
HF-Quantization/Llama-3.2-1B-BNB-FP4
Updated • 65 -
HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16
Updated • 13 -
HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16
Updated • 20 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W8
Updated • 15 -
HF-Quantization/Llama-3.2-1B-TORCHAO-W4
Updated • 12 -
HF-Quantization/Llama-3.2-1B-GPTQ-INT4
Updated • 57