neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • Updated 12 days ago • 14.3k • 30
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • Updated Dec 17, 2024 • 535k • 24
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • Updated Oct 23, 2024 • 1.22k • 9
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • Updated Oct 10, 2024 • 324 • 12
neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • Updated Oct 19, 2024 • 296 • 14
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • Updated Dec 3, 2024 • 109 • 2
neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • Updated Oct 19, 2024 • 3.42k • 6
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • Updated 13 days ago • 7.42k • 19
neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8-dynamic Text Generation • Updated Oct 19, 2024 • 7.35k • 5
neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • Updated Oct 23, 2024 • 7.43k • 14
neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • Updated Oct 9, 2024 • 479 • 4
neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • Updated Oct 9, 2024 • 27 • 2