Edit Models filters

Inference Providers

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,159

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-70m-deduped-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 5

Xu-Ouyang/pythia-70m-deduped-int3-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 5

Xu-Ouyang/pythia-70m-deduped-int3-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-70m-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 79

Xu-Ouyang/pythia-70m-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 82

Xu-Ouyang/pythia-70m-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 16, 2024 • 81

Xu-Ouyang/pythia-70m-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 9, 2024 • 12

Xu-Ouyang/pythia-70m-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 9, 2024 • 7

Xu-Ouyang/pythia-70m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 9

Xu-Ouyang/pythia-70m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 7

Xu-Ouyang/pythia-70m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 7

Xu-Ouyang/pythia-70m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 6

Xu-Ouyang/pythia-70m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Aug 16, 2024 • 8

28Smiles/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Jul 17, 2024 • 78

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated Sep 25, 2024 • 7

alouafi/Meta-llama-3-8B-Instruct-GPTQ-temp

Text Generation • Updated Jul 17, 2024 • 76

luis5tb/prometheus-eval-8x7b-gptq-marlin-vmwareds-4096

Text Generation • Updated Jul 17, 2024 • 8

nm-testing/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Jul 23, 2024 • 7

aryamannningombam/llama-3-GPTQ_g64-3bits

Text Generation • Updated Jul 17, 2024 • 80

aryamannningombam/llama-3-GPTQ_g64-8bits

Text Generation • Updated Jul 17, 2024 • 9

aryamannningombam/llama-3-GPTQ_g128-4bits

Text Generation • Updated Jul 17, 2024 • 78

lk11/opt-125m-gptq-4bit

Text Generation • Updated Jul 17, 2024 • 81

aryamannningombam/gemma-GPTQ_g128-3bits

Text Generation • Updated Jul 17, 2024 • 78

AminBH/Llama-3-8B-GPTQ-wiki-8bit

Text Generation • Updated Jul 17, 2024 • 7

Xu-Ouyang/pythia-14m-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 77

Xu-Ouyang/pythia-14m-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int3-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 80