Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,452

Full-text search

Active filters: gptq

gdsaikrishna/Qwen1_7B_base_gptq_int4_g128_wikitext2

Text Generation • Updated Jul 3, 2024 • 84

acl-srw-2024/SeaLLM-7B-v2.5-unsloth-sft-epoch-3-gptq-8bit

Text Generation • Updated Jul 3, 2024 • 11

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3, 2024 • 369 • 3

minyichen/Llama-3-Taiwan-8B-Instruct-GPTQ

Text Generation • Updated Jul 5, 2024 • 29

openerotica/WizardLM-2-8x22B-GPTQ-ERQ

Text Generation • Updated Jul 25, 2024 • 21 • 1

openerotica/c4ai-command-r-plus-GPTQ-ERQ

Text Generation • Updated Jul 14, 2024 • 16

4darsh-Dev/Meta-Llama-3-8B-quantized-GPTQ

Text Generation • Updated Jul 6, 2024 • 1

ModelCloud/DeepSeek-V2-Lite-gptq-4bit

Text Generation • Updated Jul 9, 2024 • 42

DariaaaS/test_point

Text Generation • Updated Jul 6, 2024 • 6

mkmagee/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Jul 8, 2024 • 6

ModelCloud/internlm-2.5-7b-gptq-4bit

Feature Extraction • Updated Jul 9, 2024 • 27

ModelCloud/internlm-2.5-7b-chat-gptq-4bit

Feature Extraction • Updated Jul 9, 2024 • 13

ModelCloud/internlm-2.5-7b-chat-1m-gptq-4bit

Feature Extraction • Updated Jul 9, 2024 • 14

acl-srw-2024/mistral-7b-unsloth-gptq-8bit-v2

Text Generation • Updated Jul 8, 2024 • 6

sunrisexu233/test

Text Generation • Updated Jul 8, 2024 • 9

DariaaaS/test_smallchunks

Updated Jul 9, 2024 • 5

pe-nlp/deepseek-pt-v3-quantized-int4

Text Generation • Updated Aug 5, 2024 • 9

AminBH/Llama-3-8B-Quarot-wiki-4bit

Text Generation • Updated Jul 9, 2024 • 524

AminBH/Llama-3-8B-Quarot-wiki-8bit

Text Generation • Updated Jul 9, 2024 • 522

NgaNTQ/LAWQA_VinaLLAMA2b

Text Generation • Updated Jul 9, 2024 • 6

DariaaaS/fanfiction-largedataset-test-ft

Updated Jul 10, 2024 • 10

neuralmagic/Qwen2-0.5B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 238

neuralmagic/Qwen2-1.5B-Instruct-quantized.w4a16

Text Generation • Updated Jul 18, 2024 • 727

Xu-Ouyang/pythia-1.4b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 6

Xu-Ouyang/pythia-1.4b-deduped-int2-step71000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 6

Xu-Ouyang/pythia-1.4b-deduped-int2-step107000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 7

Xu-Ouyang/pythia-1.4b-deduped-int2-step110000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 6

Xu-Ouyang/pythia-12b-deduped-int2-step36000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 6

Xu-Ouyang/pythia-1.4b-deduped-int2-step143000-GPTQ-wikitext2

Text Generation • Updated Jul 10, 2024 • 6

Xu-Ouyang/pythia-1.4b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated Aug 17, 2024 • 6