Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

379

Full-text search

Active filters: quantization

jmurray10/phase4-quantum-compression

Updated 6 days ago

llmat/Qwen3-30B-A3B-Instruct-2507-NVFP4

Text Generation • 17B • Updated 6 days ago • 24

llmat/Qwen3-4B-Instruct-2507-NVFP4

Text Generation • 3B • Updated 6 days ago • 5

brandonbeiler/InternVL3_5-GPT-OSS-20B-A4B-Preview-FP8-Dynamic

Image-Text-to-Text • 21B • Updated 3 days ago • 117

brandonbeiler/InternVL3_5-14B-FP8-Dynamic

Image-Text-to-Text • 15B • Updated 6 days ago • 29

brandonbeiler/InternVL3_5-4B-FP8-Dynamic

Image-Text-to-Text • 5B • Updated 6 days ago • 12

brandonbeiler/InternVL3_5-2B-FP8-Dynamic

Image-Text-to-Text • 2B • Updated 6 days ago • 15

brandonbeiler/InternVL3_5-1B-FP8-Dynamic

Image-Text-to-Text • 1B • Updated 6 days ago • 10

llmat/Qwen3-30B-A3B-NVFP4

Text Generation • 17B • Updated 6 days ago • 12

llmat/Qwen3-32B-NVFP4

Text Generation • 19B • Updated 6 days ago • 13

llmat/Qwen3-14B-NVFP4

Text Generation • 9B • Updated 6 days ago • 12

llmat/Qwen3-8B-NVFP4

Text Generation • 5B • Updated 6 days ago • 8

llmat/Qwen3-4B-NVFP4

Text Generation • 3B • Updated 6 days ago • 5

llmat/Qwen3-1.7B-NVFP4

Text Generation • 1B • Updated 6 days ago • 9

llmat/Qwen3-0.6B-NVFP4

Text Generation • 0.6B • Updated 6 days ago • 15

NangWeiLun/MiMo-VL-7B-SFT-bnb-4bit-nf4-dq

Image-Text-to-Text • 8B • Updated 5 days ago • 5

NangWeiLun/MiMo-VL-7B-SFT-bnb-4bit-nf4

Image-Text-to-Text • 8B • Updated 5 days ago • 27

NangWeiLun/MiMo-VL-7B-SFT-bnb-4bit-fp4

Image-Text-to-Text • 8B • Updated 5 days ago • 96

brabooObrabo/Qwen3-4B-Instruct-2507-MLX-4bit-GS32-embed-8bit-GS32

Text Generation • 0.8B • Updated 3 days ago • 40