TheBlokes Base Llama 2 GPTQ's - a lallesx Collection

lallesx 's Collections

TheBlokes Base Llama 2 GGML's

TheBlokes Base Llama 2 GGUF's

TheBlokes Base Llama 2 GPTQ's

TheBlokes Base Llama quants

TheBlokes Base Llama 2 GPTQ's

updated Sep 10, 2023

His base GPTQ quants for Llama 2 & CodeLlama

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 22.2k • 81
TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 23k • 263
TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 886 • 121
TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 13.4k • 362
TheBloke/Llama-2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 2.13k • 83
TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 6.99k • 261
TheBloke/CodeLlama-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 342 • 14
TheBloke/CodeLlama-7B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 747 • 46
TheBloke/CodeLlama-7B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 176 • 23
TheBloke/CodeLlama-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 185 • 11
TheBloke/CodeLlama-13B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 318 • 39
TheBloke/CodeLlama-13B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 169 • 20
TheBloke/CodeLlama-34B-GPTQ

Text Generation • Updated Sep 27, 2023 • 135 • 20
TheBloke/CodeLlama-34B-Instruct-GPTQ

Text Generation • Updated Sep 27, 2023 • 289 • 74
TheBloke/CodeLlama-34B-Python-GPTQ

Text Generation • Updated Sep 27, 2023 • 93 • 14