numen-tech
/

DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

4-bit GPTQ quantized version of DeepSeek-R1-Distill-Qwen-7B for inference with the Private LLM app.

Downloads last month: -

Model tree for numen-tech/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

Quantized

(156)

this model