Edit Models filters

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,159

Full-text search

Active filters: gptq

Xu-Ouyang/pythia-14m-int3-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 79

Xu-Ouyang/pythia-14m-int3-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 80

Xu-Ouyang/pythia-14m-int3-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int4-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int4-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int4-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int8-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

AminBH/Llama-3-8B-GPTQ-wiki-4bit

Text Generation • Updated Jul 17, 2024 • 80

Xu-Ouyang/pythia-14m-int8-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int8-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 78

Xu-Ouyang/pythia-14m-int8-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 17, 2024 • 81

tedindie/semikong-8b-awq

Text Generation • Updated Jul 18, 2024 • 75

infly/INF-34B-Chat-GPTQ-4bit

Text Generation • Updated Jul 25, 2024 • 4 • 1

infly/INF-34B-Chat-GPTQ-8bit

Text Generation • Updated Jul 25, 2024 • 5

Nkumah7/gemma-1.1-2b-it-4bit-gptq

Text Generation • Updated Jul 18, 2024 • 74

Xu-Ouyang/pythia-1.4b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • Updated Jul 18, 2024 • 75

Xu-Ouyang/pythia-1.4b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • Updated Jul 18, 2024 • 75

Xu-Ouyang/pythia-410m-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • Updated Jul 18, 2024 • 75

Xu-Ouyang/pythia-410m-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 75

Xu-Ouyang/pythia-1.4b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 75

Xu-Ouyang/pythia-6.9b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 75

Xu-Ouyang/pythia-410m-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 75

Xu-Ouyang/pythia-410m-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 75

Xu-Ouyang/pythia-1.4b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 76

Xu-Ouyang/pythia-410m-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 75

Xu-Ouyang/pythia-410m-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 3

Xu-Ouyang/pythia-1.4b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • Updated Jul 19, 2024 • 3