Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-Instruct-2409-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
2
Train
Use this model
70df41a
Mistral-Small-Instruct-2409-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
743142d8bc7697065359f49e94ed56b82c20cf554c94696b9c1b7f39bf016e2f
70df41a
verified
3 months ago
.gitattributes
Safe
2.81 kB
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409-GGUF_imatrix.dat
11.9 MB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.IQ1_M.gguf
5.27 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.IQ1_S.gguf
4.83 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.IQ2_XS.gguf
6.65 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.IQ3_XS.gguf
9.18 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.IQ4_XS.gguf
11.9 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.Q2_K.gguf
8.27 GB
LFS
0d28c3482790df1284f9e2e7e1fbf8f7a364619ab1593ed5528eb75d7a77b92d
3 months ago
Mistral-Small-Instruct-2409.Q3_K_L.gguf
11.7 GB
LFS
346eb1d1d5ae2b7b964d8b5a9a97538e1675c1e6304ef9d599995f977a57f427
3 months ago
Mistral-Small-Instruct-2409.Q3_K_M.gguf
10.8 GB
LFS
ad5a361c29248d05bbe2fda452fef26f8b5eedbd55d7be788122767140a6ccd8
3 months ago
Mistral-Small-Instruct-2409.Q3_K_S.gguf
9.64 GB
LFS
f15b7abc9e09613cf7931447a8a74469c1ca8a36d13f05cfd4428872db89c631
3 months ago
Mistral-Small-Instruct-2409.Q4_K_M.gguf
13.3 GB
LFS
40ae70d9124b6e3da01a72a8d3070d8c5895845e781ce319d30d8536c6372ad8
3 months ago
Mistral-Small-Instruct-2409.Q4_K_S.gguf
12.7 GB
LFS
6b10d62a7b97013fa426776ce5d0e301a7734fab3414c84acd449950488f0d49
3 months ago
Mistral-Small-Instruct-2409.Q5_K_M.gguf
15.7 GB
LFS
9063e603d56a619f37bd57820de4b7e3b798fc50f3c10f0f69f012a01cc0e8c5
3 months ago
Mistral-Small-Instruct-2409.Q5_K_S.gguf
15.3 GB
LFS
743142d8bc7697065359f49e94ed56b82c20cf554c94696b9c1b7f39bf016e2f
3 months ago
Mistral-Small-Instruct-2409.Q6_K.gguf
18.3 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.Q8_0.gguf
23.6 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
Mistral-Small-Instruct-2409.fp16.gguf
44.5 GB
LFS
Upload folder using huggingface_hub (#1)
6 months ago
README.md
Safe
3.06 kB
Upload folder using huggingface_hub (#1)
6 months ago
config.json
Safe
31 Bytes
Upload folder using huggingface_hub
6 months ago
