GGUF
community
AI & ML interests
Our goal is to simplify the process of searching for and exchanging quantized models in GGUF format, as well as to create a space for efficient exchange and access to the models you need
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 18 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 83 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 6 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 13 • 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 23 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 8 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation • 2B • Updated • 8 • 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation • 8B • Updated • 18 • 1
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 2 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 34 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 9 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 31
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 26 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 8 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 42 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 18
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 13 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated • 15 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 5 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated • 12
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation • 12B • Updated • 18 • 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation • 12B • Updated • 83 • 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation • 7B • Updated • 6 • 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation • 12B • Updated • 13 • 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 23 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 8 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation • 2B • Updated • 8 • 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation • 8B • Updated • 18 • 1
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 13 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B • Updated • 15 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 5 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation • 3B • Updated • 12
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated • 2 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated • 34 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated • 9 • 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation • 8B • Updated • 31
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 26 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B • Updated • 8 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation • 0.5B • Updated • 42 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation • 2B • Updated • 18