Models

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 3.29k • 215

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 1.24k • 583

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated Jun 19 • 1.22k • 3

tencent/Hunyuan-0.5B-Instruct-GPTQ-Int4

Text Generation • 0.2B • Updated about 5 hours ago • 182 • 2

baichuan-inc/Baichuan-M2-32B-GPTQ-Int4

Text Generation • 6B • Updated 21 days ago • 1.21k • 7

TheBloke/BigTranslate-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 1.87k • 19

TheBloke/WizardLM-13B-V1.0-Uncensored-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 1.24k • 30

TheBloke/guanaco-13B-SuperHOT-8K-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 14 • 8

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 1.15k • 149

TheBlokeAI/jackfram_llama-68m-GPTQ

Text Generation • 0.1B • Updated Sep 21, 2023 • 13 • 1

TheBloke/storytime-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 1.15k • 40

TheBloke/TinyLlama-1.1B-Chat-v1.0-GPTQ

Text Generation • 0.3B • Updated Dec 31, 2023 • 109k • 14

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • 2B • Updated Jan 26, 2024 • 44 • 19

TheBloke/Tess-34B-v1.5b-GPTQ

Text Generation • 5B • Updated Jan 28, 2024 • 13 • 8

TechxGenus/starcoder2-7b-instruct-GPTQ

Text Generation • 1B • Updated Mar 24, 2024 • 14 • 2

RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • 1B • Updated Jun 10, 2024 • 75.8k • 20

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 29k • 37

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 2B • Updated 6 days ago • 46.8k • 30

Qwen/Qwen2.5-1.5B-Instruct-GPTQ-Int8

Text Generation • 0.6B • Updated Oct 9, 2024 • 1.23k • 4

shuyuej/Llama-3.2-1B-Instruct-GPTQ

0.4B • Updated Sep 25, 2024 • 8.17k • 3

kaitchup/Llama-3.3-70B-Instruct-AutoRoundGPTQ-8bit

Text Generation • 20B • Updated Feb 26 • 56 • 1

kaitchup/Qwen3-0.6B-autoround-4bit-gptq

0.2B • Updated May 2 • 14 • 3

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated May 21 • 3.88k • 23

tencent/Hunyuan-A13B-Instruct-GPTQ-Int4

Text Generation • 11B • Updated Jul 11 • 17.1k • 48

QuantTrio/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8

Text Generation • 8B • Updated 13 days ago • 4.06k • 5

xiangxinai/Xiangxin-Guardrails-Text

Text Generation • 3B • Updated 3 days ago • 171 • 4

mediainbox/MiMo-VL-7B-RL-2508-gptq-q4

Image-to-Text • 3B • Updated 16 days ago • 112 • 1

Joseph200105/GPT2-GPTQ-int4

Updated 2 days ago • 2 • 1

TheBloke/MLewdBoros-L2-13B-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 11 • 26

TheBloke/Mistral-11B-CC-Air-RP-GPTQ

Text Generation • 2B • Updated Oct 15, 2023 • 5 • 7