neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated Oct 23, 2024 • 7.2k • 14
neuralmagic/Mistral-Nemo-Instruct-2407-quantized.w4a16 Text Generation • Updated Oct 9, 2024 • 600 • 4
neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 Text Generation • Updated 1 day ago • 733 • 1
neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16 Text Generation • Updated 1 day ago • 834 • 1
neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8 Text Generation • Updated 1 day ago • 4.14k • 3