kaitchup
/

QwQ-32B-AutoRoundGPTQ-8bit

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

QwQ-32B-AutoRoundGPTQ-8bit / model.safetensors.index.json

Commit History

Upload Qwen2ForCausalLM

610c5a1
verified

bnjmnmarie commited on 4 days ago