Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2210.17323

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Mixture of Experts

Models

152

Full-text search

Active filters: 2210.17323

neuralmagic/Phi-3-medium-128k-instruct-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 5.2k • 3

neuralmagic/Qwen2-7B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 157

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 70

neuralmagic/Qwen2-72B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 97 • 1

rinna/llama-3-youko-8b-gptq

Text Generation • Updated Aug 31, 2024 • 106

rinna/llama-3-youko-8b-instruct-gptq

Text Generation • Updated Aug 31, 2024 • 105 • 1

rinna/llama-3-youko-70b-gptq

Text Generation • Updated Aug 31, 2024 • 11

rinna/llama-3-youko-70b-instruct-gptq

Text Generation • Updated Aug 31, 2024 • 14

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated Oct 23, 2024 • 1.34k • 9

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 469 • 4

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated 13 days ago • 7.73k • 19

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 12k • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 236 • 2

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated 12 days ago • 16.1k • 30

neuralmagic/starcoder2-15b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 72

neuralmagic/starcoder2-3b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 88

neuralmagic/starcoder2-7b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 85

neuralmagic/starcoder2-3b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 131

neuralmagic/starcoder2-7b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 88

neuralmagic/starcoder2-15b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 12

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10, 2024 • 370 • 12

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 448 • 1

neuralmagic/gemma-2-2b-it-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 16 • 1

neuralmagic/gemma-2-2b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 45

neuralmagic/gemma-2-9b-it-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 196 • 1

neuralmagic/gemma-2-2b-it-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 2.55k • 1

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 84

neuralmagic/gemma-2-2b-it-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 43

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Dec 3, 2024 • 135 • 2

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 29 • 2