HF Quantization

community

AI & ML interests

Making AI models smaller, and faster with Quantization

Collections 1

spaces 3

TorchAO

Quantize and save Hugging Face models

Running on A10G

BitsAndBytes

Quantize and upload models to Hugging Face

TorchAO

Quantize and save Hugging Face models

models 11

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W8

HF-Quantization/Llama-3.3-70B-Instruct-TORCHAO-W4

Updated Jan 22 • 10

HF-Quantization/Llama-3.2-1B-BNB-INT8

1B • Updated Jan 21 • 1

HF-Quantization/Llama-3.2-1B-BNB-NF4

0.8B • Updated Jan 21 • 3

HF-Quantization/Llama-3.2-1B-BNB-FP4

0.8B • Updated Jan 21 • 6

HF-Quantization/Llama-3.2-1B-BNB-NF4-BF16

0.8B • Updated Jan 21

HF-Quantization/Llama-3.2-1B-BNB-FP4-BF16

0.8B • Updated Jan 21 • 1

HF-Quantization/Llama-3.2-1B-TORCHAO-W8A8

Updated Jan 21 • 7

HF-Quantization/Llama-3.2-1B-TORCHAO-W8

HF-Quantization/Llama-3.2-1B-TORCHAO-W4

datasets 0

None public yet