Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

5,146

Full-text search

Active filters: exl2

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 11 days ago • 94

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation • Updated about 5 hours ago • 94 • 3

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_5.0bpw_H8

Text Generation • Updated Jan 26 • 248 • 2

matatonic/QwQ-32B-abliterated-6.5bpw-h8-exl2

Text Generation • Updated 6 days ago • 17 • 2

matatonic/OlympicCoder-32B-6.5bpw-h8-exl2

Text Generation • Updated 1 day ago • 5 • 2

Natkituwu/Erosumika-7B-v3-7.1bpw-exl2

Text Generation • Updated Mar 26, 2024 • 31 • 1

LoneStriker/dolphin-2.9-llama3-70b-5.0bpw-h6-exl2

Text Generation • Updated Apr 25, 2024 • 5.43k • 3

DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal

Text Generation • Updated May 19, 2024 • 35 • 1

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 21 • 2

Orion-zhen/Qwen2-72B-Instruct-2.0bpw-h-novel-exl2

Text Generation • Updated Jun 12, 2024 • 26 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 16 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 26 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 24 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 21 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 23 • 1

grimjim/Mistral-Nemo-Instruct-2407-12B-6.4bpw-exl2

Text Generation • Updated Aug 25, 2024 • 41 • 5

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 13 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 15 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 15 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 13 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 13 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 15 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 12 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 12 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 13 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 14 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 85 • 4

Statuo/NemoMix-Unleashed-EXL2-6bpw

Text Generation • Updated Aug 23, 2024 • 39 • 4