Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
mergekit-passthrough-yqhuxcv-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
conversational
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
1342967
mergekit-passthrough-yqhuxcv-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
031c0fb60b4eb073bc2f5ae833ec82b4080c487377788e5f40eccbdeaa7a156f
1342967
verified
8 months ago
.gitattributes
2.28 kB
031c0fb60b4eb073bc2f5ae833ec82b4080c487377788e5f40eccbdeaa7a156f
8 months ago
mergekit-passthrough-yqhuxcv.Q2_K.gguf
16.9 GB
LFS
152ba291c40fdf56cf1331b3c756248b801b0276e4674dcb5413147bfd066a9a
8 months ago
mergekit-passthrough-yqhuxcv.Q3_K_L.gguf
23.7 GB
LFS
9f85c5f77355ae8d938c6830ea3bc55e5deeb4e6b0f0435e4d0067983541eabc
8 months ago
mergekit-passthrough-yqhuxcv.Q3_K_M.gguf
21.9 GB
LFS
b39388dbc226809ee78ff50797bc71dc26dfd4c384bddef812c705c729073323
8 months ago
mergekit-passthrough-yqhuxcv.Q3_K_S.gguf
19.7 GB
LFS
c6efd46e62ea38adb5803a904a04b942da7a010d47ef9c0f0ca00b83b740bf83
8 months ago
mergekit-passthrough-yqhuxcv.Q4_K_M.gguf
27.1 GB
LFS
dd3e51ed299f4ec8cfca2524a26a5cb05530f4db9e73242ae63586daf55cabd3
8 months ago
mergekit-passthrough-yqhuxcv.Q4_K_S.gguf
25.7 GB
LFS
8c401371fcb269f3ab279d77597adf339ecf1f1ca37f4148a32b0acbf858126a
8 months ago
mergekit-passthrough-yqhuxcv.Q5_K_M.gguf
31.8 GB
LFS
b15a6165fbb4398afaa1a6f12ded0efb2d77af16674a1fe067915773a1b440f7
8 months ago
mergekit-passthrough-yqhuxcv.Q5_K_S.gguf
31 GB
LFS
8091e4f609a5cbc8c47ae5cfdf0ec7df959b9219bf648d8540631d418243b158
8 months ago
mergekit-passthrough-yqhuxcv.Q6_K.gguf
36.8 GB
LFS
eb6b8c6399f70e6688b179bf7204e34579339743450e96f1cf8877f7a8ef131f
8 months ago
mergekit-passthrough-yqhuxcv.Q8_0.gguf
47.7 GB
LFS
031c0fb60b4eb073bc2f5ae833ec82b4080c487377788e5f40eccbdeaa7a156f
8 months ago
