mradermacher
/

llama-3-typhoon-v1.5x-8b-instruct-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama-3-typhoon-v1.5x-8b-instruct-i1-GGUF

1 contributor

History: 16 commits

mradermacher's picture

uploaded from rich1

5ddfd92 verified 20 days ago

.gitattributes

2.67 kB

uploaded from rich1 20 days ago
README.md

248 Bytes

uploaded from rich1 20 days ago
imatrix.dat

4.99 MB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-IQ1_M.gguf

2.16 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-IQ2_M.gguf

2.95 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-IQ3_M.gguf

3.78 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-IQ3_XXS.gguf

3.27 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-IQ4_NL.gguf

4.68 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-IQ4_XS.gguf

4.45 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q2_K.gguf

3.18 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q2_K_S.gguf

2.99 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q3_K_M.gguf

4.02 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q3_K_S.gguf

3.66 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q4_K_M.gguf

4.92 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q4_K_S.gguf

4.69 GB
LFS

uploaded from rich1 20 days ago
llama-3-typhoon-v1.5x-8b-instruct.i1-Q6_K.gguf

6.6 GB
LFS

uploaded from rich1 20 days ago