Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Q2.5-Veltha-14B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
refs/pr/1
Q2.5-Veltha-14B-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
3fb92eded11382eebf43c1bf9b2c85b572b6cae851443cbad13eeb5b2a6479bc
f39cf4e
verified
3 months ago
.gitattributes
Safe
1.9 kB
3fb92eded11382eebf43c1bf9b2c85b572b6cae851443cbad13eeb5b2a6479bc
3 months ago
Q2.5-Veltha-14B-GGUF_imatrix.dat
8.56 MB
LFS
3fb92eded11382eebf43c1bf9b2c85b572b6cae851443cbad13eeb5b2a6479bc
3 months ago
Q2.5-Veltha-14B.Q5_K_M.gguf
10.5 GB
LFS
568bc216a7cb59efbc9ca4a4812952d2734955f6a8081a7b866ac0ebdb6003c7
3 months ago
Q2.5-Veltha-14B.Q5_K_S.gguf
10.3 GB
LFS
a4a8ff1c8a51eae56ee4f067dcd0317f4d2cd00d42371c37909c98ef69d749a1
3 months ago
Q2.5-Veltha-14B.Q6_K.gguf
12.1 GB
LFS
f7c153369950aac50387427a46fb26121845f52bd5a39a97f412e5d24d9b4bf5
3 months ago
Q2.5-Veltha-14B.Q8_0.gguf
15.7 GB
LFS
95eedb2966f91158f600e5bc5a5fe127e38e0b04d04ca6709789c2ad59d22d9f
3 months ago
Q2.5-Veltha-14B.fp16.gguf
29.5 GB
LFS
e3c137e10f0314c53dd284a2b54e539b8a2d49a390b2faa60fd8306e91626ad2
3 months ago
README.md
Safe
2.89 kB
3fb92eded11382eebf43c1bf9b2c85b572b6cae851443cbad13eeb5b2a6479bc
3 months ago
