Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,837

Full-text search

Active filters: chat

Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 140 • 7

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 173 • 13

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 270 • 4

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 39k • 4

unsloth/tinyllama-chat

Text Generation • Updated Sep 3, 2024 • 8.49k • • 3

timpal0l/Mistral-7B-v0.1-flashback-v2-instruct

Text Generation • Updated Feb 22, 2024 • 57 • 5

Qwen/Qwen1.5-MoE-A2.7B-Chat

Text Generation • Updated Apr 30, 2024 • 6.66k • 119

MarsupialAI/KitchenSink_103b_iMatrix_GGUF

Updated May 11, 2024 • 42 • 1

Qwen/Qwen1.5-MoE-A2.7B-Chat-GPTQ-Int4

Text Generation • Updated Jun 9, 2024 • 385 • 44

Qwen/Qwen1.5-32B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 2.92k • 30

nazlicanto/phi-2-persona-chat

Text Generation • Updated Apr 2, 2024 • 22 • 5

Qwen/Qwen1.5-32B-Chat

Text Generation • Updated Apr 30, 2024 • 2.96k • 109

Qwen/Qwen1.5-32B-Chat-GGUF

Text Generation • Updated Apr 9, 2024 • 711 • 53

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 41 • 18

LenguajeNaturalAI/leniachat-gemma-2b-v0

Text Generation • Updated Apr 13, 2024 • 240 • • 14

Qwen/CodeQwen1.5-7B-Chat

Text Generation • Updated Apr 30, 2024 • 3.21k • 329

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 348 • 14

Qwen/CodeQwen1.5-7B-Chat-GGUF

Text Generation • Updated Apr 23, 2024 • 3.21k • 108

Qwen/Qwen1.5-110B-Chat

Text Generation • Updated Apr 30, 2024 • 4.88k • 125

Qwen/Qwen1.5-110B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 68 • 17

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 39 • 9

Qwen/Qwen1.5-110B-Chat-GGUF

Text Generation • Updated Apr 30, 2024 • 44 • 14

wdndev/tiny_llm_sft_92m

Text Generation • Updated May 27, 2024 • 224 • 5

scb10x/llama-3-typhoon-v1.5-8b-instruct

Text Generation • Updated Jul 4, 2024 • 70.3k • • 26

lordjia/wawj-7b-chat-gguf

Text Generation • Updated Jun 14, 2024 • 36 • 2

lordjia/wawj-1.8b-chat-gguf

Text Generation • Updated May 17, 2024 • 20 • 2

THUDM/cogvlm2-llama3-chat-19B

Text Generation • Updated Sep 3, 2024 • 5.45k • 210

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 653 • 28

Qwen/Qwen2-72B-Instruct

Text Generation • Updated Oct 8, 2024 • 36k • • 713

reach-vb/CodeQwen1.5-7B-Chat-Q3_K_S-GGUF

Text Generation • Updated May 30, 2024 • 9 • 1