Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,224

Full-text search

Active filters: awq

Qwen/QwQ-32B-AWQ

Text Generation • Updated 2 days ago • 72.4k • 84

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 26 days ago • 43.7k • 70

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 25 days ago • 166k • 37

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 163k • 38

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 50.7k • 63

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated 25 days ago • 23.1k • 22

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 129 • 1

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 26 • 3

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 156 • 7

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 3.04k • 30

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 4.38k • 38

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • Updated Nov 9, 2023 • 195 • 17

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 212 • 35

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 879 • 72

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 2.75k • 36

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 1.51k • 16

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 88 • 3

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 251 • 1

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • Updated Nov 29, 2023 • 1.11k • 2

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 44.8k • 43

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 20.8k • 4

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1, 2024 • 35.2k • 22

internlm/internlm2-chat-20b-4bits

Text Generation • Updated Apr 24, 2024 • 1.07k • 7

TheBloke/DiscoLM_German_7b_v1-AWQ

Text Generation • Updated Jan 24, 2024 • 726 • 4

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 236 • 5

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 556 • 24

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 730 • 22

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 171 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 643 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 157 • 3