Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment24Yam-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
7a91cc0
Experiment24Yam-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
1b7b1b09839d9d73e3538cb8cdf7b435ee9d358d18ecf0fee0f8cfc8496325e0
7a91cc0
verified
10 months ago
.gitattributes
2.19 kB
1b7b1b09839d9d73e3538cb8cdf7b435ee9d358d18ecf0fee0f8cfc8496325e0
10 months ago
Experiment24Yam-7B.IQ3_XS.gguf
3.02 GB
LFS
7cf875cdaff7d0b24619a8a580a068c57bd30d970175b1c4c39f18f89219dfff
10 months ago
Experiment24Yam-7B.IQ4_XS.gguf
3.94 GB
LFS
1754396caa698ff3d7fd780ac07640ef0f280cc584b2a78f69f0861e62b582c1
10 months ago
Experiment24Yam-7B.Q2_K.gguf
2.72 GB
LFS
ede570031b8d9af85043e61f9d99d8860f5e149416eb007df93783f6fed69625
10 months ago
Experiment24Yam-7B.Q3_K_L.gguf
3.82 GB
LFS
a39c934a44deac43cfdac2a5e64b4e75ce8ac43c33b1490afdf7a8861d8a711b
10 months ago
Experiment24Yam-7B.Q3_K_M.gguf
3.52 GB
LFS
e99104f9a072c4f757c9cc636858c03299ab43051136599b66094879a9721261
10 months ago
Experiment24Yam-7B.Q3_K_S.gguf
3.16 GB
LFS
9c3729d4bc286f11578cbd030f2a47c55bb0cf0d35d1451451a8c5681e80715b
10 months ago
Experiment24Yam-7B.Q4_K_M.gguf
4.37 GB
LFS
3c8f39932bc8f752490836ab19f192a840020f8425f98d6b709c0d08de629089
10 months ago
Experiment24Yam-7B.Q4_K_S.gguf
4.14 GB
LFS
77618c307b05347d8e5ebc14c0d2b9efb54bf7f8f9c3151b81b7ffa1bdc15637
10 months ago
Experiment24Yam-7B.Q5_K_M.gguf
5.13 GB
LFS
9db575b7e9c775b7284409bb20a83d21982d100fd4d89d33275ae115234fb831
10 months ago
Experiment24Yam-7B.Q5_K_S.gguf
5 GB
LFS
1b7b1b09839d9d73e3538cb8cdf7b435ee9d358d18ecf0fee0f8cfc8496325e0
10 months ago
