Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
CISCai
/
granite-3.2-8b-instruct-SOTA-GGUF
like
0
Text Generation
GGUF
m-a-p/CodeFeedback-Filtered-Instruction
code
language
granite-3.2
imatrix
conversational
arxiv:
0000.00000
License:
apache-2.0
Model card
Files
Files and versions
Community
Use this model
main
granite-3.2-8b-instruct-SOTA-GGUF
1 contributor
History:
5 commits
CISCai
Added RAG and reasoning examples
e841d9d
verified
20 days ago
.gitattributes
Safe
2.55 kB
Upload 13 files
20 days ago
README.md
Safe
33.1 kB
Added RAG and reasoning examples
20 days ago
granite-3.2-8b-instruct-bf16-00001-of-00002.gguf
1.72 MB
LFS
Upload 2 files
20 days ago
granite-3.2-8b-instruct-bf16-00002-of-00002.gguf
16.3 GB
LFS
Upload 2 files
20 days ago
granite-3.2-8b-instruct.IQ1_M.gguf
2 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ1_S.gguf
1.84 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ2_M.gguf
2.84 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ2_S.gguf
2.62 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ2_XS.gguf
2.5 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ2_XXS.gguf
2.27 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ3_M.gguf
3.74 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ3_S.gguf
3.61 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ3_XS.gguf
3.43 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ3_XXS.gguf
3.2 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.IQ4_XS.gguf
4.43 GB
LFS
Upload 13 files
20 days ago
granite-3.2-8b-instruct.imatrix.dat
5.99 MB
LFS
Upload 13 files
20 days ago
