John6666
/

Llama-3.2-3B-Instruct-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Quants of unsloth/Llama-3.2-3B-Instruct.

Downloads last month: 2

Safetensors

Model size

1.14B params

Tensor type

F32

·

BF16

·

U8

·

Model tree for John6666/Llama-3.2-3B-Instruct-bnb-4bit

Base model

meta-llama/Llama-3.2-3B-Instruct

Finetuned

unsloth/Llama-3.2-3B-Instruct

Quantized

(107)

this model