Quantized from deepseek-ai/DeepSeek-R1-Distill-Qwen-32B down to 4 bits, GEMM.

Downloads last month: 3

Safetensors

Model size

5.73B params

Tensor type

I32

BF16

FP16

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for graelo/DeepSeek-R1-Distill-Qwen-32B-AWQ

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Quantized

(75)

this model