Edit Models filters

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,111

Full-text search

Active filters: 8-bit

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 4.74k • 14

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10, 2024 • 8.47k • 19

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1, 2024 • 1.09M • 12

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 11 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 179 • 4

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 7.09k • 26

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 4.17k • 13

watsonchua/hansard-gemma-2-9b-lora

Updated Sep 2, 2024 • 2 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 1.04M • 5

qeternity/Mistral-Large-Instruct-2407-w8a8

Updated Sep 7, 2024 • 4 • 1

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.31k • 169

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13, 2024 • 1.04M • 24

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24, 2024 • 2.21k • 10

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 37.3k • 8

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 24.5k • 12

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 5.04k • 17

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.04M • 3

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.06M • 9

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 715k • 10

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.06M • 8

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1, 2024 • 18 • 3

malenia1/ternary-weight-embedding

Updated Dec 16, 2024 • 1.24k • 5

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Oct 30, 2024 • 51 • 3

MaziyarPanahi/llm_3_2_flux_prompt-GGUF

Text Generation • Updated Nov 2, 2024 • 184 • 1

MaziyarPanahi/Llama-3.2-1B-GGUF

Text Generation • Updated Nov 2, 2024 • 445 • 1

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3, 2024 • 142 • 2

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18, 2024 • 16.4k • 16

mlx-community/Qwen2.5-Coder-32B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 172 • 8

lmstudio-community/Qwen2.5-Coder-32B-Instruct-MLX-8bit

Text Generation • Updated Nov 13, 2024 • 181 • 2

prithivMLmods/Marco-o1-GGUF

Text Generation • Updated Dec 5, 2024 • 516 • 12