Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Lewdiculous
/
Rawr_Llama3_8B-GGUF-IQ-Imatrix
like
5
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Use this model
main
Rawr_Llama3_8B-GGUF-IQ-Imatrix
1 contributor
History:
7 commits
Lewdiculous
Update README.md
7d828ac
verified
10 months ago
.gitattributes
Safe
2.39 kB
Add all.
10 months ago
README.md
Safe
293 Bytes
Update README.md
10 months ago
imatrix.dat
4.99 MB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-IQ3_M-imat.gguf
3.78 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-IQ3_S-imat.gguf
3.68 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-IQ3_XXS-imat.gguf
3.27 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-IQ4_XS-imat.gguf
4.45 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-Q2_K-imat.gguf
3.18 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-Q4_K_M-imat.gguf
4.92 GB
LFS
Q4v2
10 months ago
v2-Rawr_Llama3_8B-Q4_K_S-imat.gguf
4.69 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-Q5_K_M-imat.gguf
5.73 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-Q5_K_S-imat.gguf
5.6 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-Q6_K-imat.gguf
6.6 GB
LFS
Add all.
10 months ago
v2-Rawr_Llama3_8B-Q8_0-imat.gguf
8.54 GB
LFS
Add all.
10 months ago
