Gemma 3
Collection
10 items
•
Updated
•
18
Multimodal GGUFs
Vision and audio models compatible with llama-server and llama-mtmd-cli
-
-
ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
Image-Text-to-Text • 24B • Updated • 411 • 4 -
ggml-org/moondream2-20250414-GGUF
0.5B • Updated • 2.28k • 3
ggml-org/pixtral-12b-GGUF
12B • Updated • 570 • 4Note . ------------ Below are audio models
-
ggml-org/ultravox-v0_5-llama-3_2-1b-GGUF
Audio-Text-to-Text • 1B • Updated • 851 • 4
ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
8B • Updated • 265 • 3Note . ------------ Below are vision+audio models
-
ggml-org/Qwen2.5-Omni-3B-GGUF
Any-to-Any • 3B • Updated • 2.65k • 10 -
ggml-org/Qwen2.5-Omni-7B-GGUF
Any-to-Any • 8B • Updated • 1.98k • 14 -
ggml-org/Voxtral-Mini-3B-2507-GGUF
4B • Updated • 3.76k • 2