Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,452

Full-text search

Active filters: gptq

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • Updated Jul 17, 2024 • 200 • 6

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • Updated Jul 23, 2024 • 35 • 2

Ksgk-fy/eCoach-v1-gptq

Text Generation • Updated Jul 11, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 18, 2024 • 6

Ksgk-fy/maria-v2-gptq

Text Generation • Updated Jul 11, 2024

Xu-Ouyang/pythia-410m-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 137

Xu-Ouyang/pythia-410m-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 136

Xu-Ouyang/pythia-410m-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 136

neuralmagic/Qwen2-72B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 29 • 4

neuralmagic/Qwen2-7B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 191

neuralmagic/Llama-2-7b-chat-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 231

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation • Updated Aug 29, 2024 • 62 • 2

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 276 • 2

Xu-Ouyang/pythia-410m-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 136

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation • Updated about 17 hours ago • 610 • 1

Xu-Ouyang/pythia-6.9b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 137

Xu-Ouyang/pythia-410m-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 137

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 11, 2024 • 137

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 136

Xu-Ouyang/pythia-6.9b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 135

Xu-Ouyang/pythia-6.9b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 12, 2024 • 136

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 9

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 6