Edit Models filters

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

21,725

Full-text search

Active filters: 8-bit

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 7.59k • 25

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated 2 days ago • 10.3k • 10

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 2 days ago • 58.4k • 9

mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit

Updated 10 days ago • 19.9k • 6

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 1.68M • 85

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.22k • 169

mlx-community/DeepSeek-R1-Distill-Qwen-1.5B-8bit

Updated 10 days ago • 20.2k • 3

mlx-community/DeepSeek-R1-Distill-Qwen-32B-MLX-8Bit

Updated 10 days ago • 74k • 3

mlx-community/Qwen2.5-14B-Instruct-1M-8bit

Text Generation • Updated 4 days ago • 131 • 2

m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx

Updated 4 days ago • 48 • 2

unsloth/Qwen2.5-14B-Instruct-1M-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 69 • 2

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese-8bit

Text Generation • Updated 3 days ago • 57 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated about 7 hours ago • 2

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated about 3 hours ago • 2

Norod78/gpt-fluentui-flat-svg

Text Generation • Updated Mar 19, 2023 • 27 • 19

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 218 • 26

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 148 • 8

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 21 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 1.27M • 74

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 1.58M • 75

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 56.5k • 126

FriendliAI/Meta-Llama-3-70B-fp8

Text Generation • Updated Aug 1, 2024 • 39 • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.67M • 76

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 16 • 2

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 1.55M • 11

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 57 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.53M • 16

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18, 2024 • 464 • 4

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22, 2024 • 1.57M • 40

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.93k • 32