Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

215,550

Full-text search

Active filters: text-generation-inference

grimjim/Mistral-Nemo-Instruct-2407-12B-6.4bpw-exl2

Text Generation • Updated Aug 25, 2024 • 34 • 5

turboderp/turbcat-instruct-72b

Text Generation • Updated Jul 19, 2024 • 26 • 28

llava-hf/llama3-llava-next-8b-hf

Image-Text-to-Text • Updated Jan 27 • 12.1k • 36

amd/AMD-Llama-135m-code

Text Generation • Updated Oct 9, 2024 • 210 • 12

Nexusflow/Athene-70B

Text Generation • Updated Nov 15, 2024 • 3.16k • 196

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 259k • 62

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 120k • 97

Svngoku/kongostral

Text Generation • Updated Jul 23, 2024 • 22 • 3

meta-llama/Llama-3.1-405B-FP8

Text Generation • Updated Dec 6, 2024 • 302 • 112

Corianas/llama-3-reactor

Text Generation • Updated Jan 20 • 38 • 2

EmergentMethods/Phi-3-mini-4k-instruct-graph

Text Generation • Updated Aug 15, 2024 • 1.2k • 41

AnatoliiPotapov/T-lite-0.1

Text Generation • Updated Jul 20, 2024 • 155 • 25

IlyaGusev/saiga_gemma2_9b

Text Generation • Updated Jul 22, 2024 • 961 • 15

amitca71/text2cypher_unsloth_Mistral-Nemo-Instruct-2407-bnb-8bit_gguf

Updated Jul 21, 2024 • 25 • 1

maharnab/gpt2_pycode

Text Generation • Updated Jul 21, 2024 • 84 • 2

princeton-nlp/Llama-3-8B-ProLong-64k-Instruct

Text Generation • Updated Oct 31, 2024 • 2.06k • 13

dohrisalim/Code-7B-slerp

Text Generation • Updated Jul 21, 2024 • 13 • 1

ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 13 • 1

ricdomolm/lawma-8b

Text Generation • Updated 27 days ago • 2.9k • 8

bunnycore/L3-Intermix-v0.2

Text Generation • Updated Jul 22, 2024 • 17 • 2

ndebuhr/Gemma-2-27B-Technical-Tutorial-Summarization-QLoRA

Text Generation • Updated Jul 22, 2024 • 14 • 1

shuyuej/Mixtral-8x22B-Instruct-v0.1-GPTQ

Text Generation • Updated Jul 25, 2024 • 13 • 1

BeaverAI/mistral-doryV2-12b

Text Generation • Updated Jul 22, 2024 • 109 • 22

IlyaGusev/saiga_tlite_8b_abliterated_sft_m1_d9

Text Generation • Updated Jul 22, 2024 • 9 • 3

EmergentMethods/Phi-3-medium-128k-instruct-graph

Text Generation • Updated Aug 15, 2024 • 59 • 29

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 14.2k • 9

braindao/iq-code-evmind-v3.2-qwen2-1.5b-instruct-average

Text Generation • Updated Aug 13, 2024 • 58 • 1

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Feb 15 • 121k • 101

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 757 • 4

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 5.16k • 31