Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-8B-Distill-CoT-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Llama-8B-Distill-CoT-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
46bf41e6c4c239a99064b97ac71e97d2d867f688cf9762cbb58c140d70b5c8a9
b76c3e7
verified
2 months ago
.gitattributes
Safe
1.93 kB
46bf41e6c4c239a99064b97ac71e97d2d867f688cf9762cbb58c140d70b5c8a9
2 months ago
Llama-8B-Distill-CoT-GGUF_imatrix.dat
4.99 MB
LFS
46bf41e6c4c239a99064b97ac71e97d2d867f688cf9762cbb58c140d70b5c8a9
2 months ago
Llama-8B-Distill-CoT.Q5_K_M.gguf
5.73 GB
LFS
902c483d0cc528e4766ffd8806922d73243abd6e3ef454c741ffea26e291c94e
2 months ago
Llama-8B-Distill-CoT.Q5_K_S.gguf
5.6 GB
LFS
31d0f5834c638df013edb743fcf86409d308c8bc54cc879dc4118ac3f0c51b3a
2 months ago
Llama-8B-Distill-CoT.Q6_K.gguf
6.6 GB
LFS
014b6465e803feefbd707fc00f604482b6cd41076fc6fb217147eec634df3204
2 months ago
Llama-8B-Distill-CoT.Q8_0.gguf
8.54 GB
LFS
2f0168d4381984d021521eab686a88e5f3f178ee3d4b12c15fe66671fa843c6f
2 months ago
Llama-8B-Distill-CoT.fp16.gguf
16.1 GB
LFS
251ba5eeda701260e2b884797df5f398053f89a4d673617bcc3a24116caf6ce8
2 months ago
README.md
Safe
3 kB
46bf41e6c4c239a99064b97ac71e97d2d867f688cf9762cbb58c140d70b5c8a9
2 months ago
