Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-24B-Instruct-2501-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
3eadd37
Mistral-Small-24B-Instruct-2501-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
987adda84827057a43027a48131fd259cdf9a756c8cee4ca7adf0d90dfa460b0
3eadd37
verified
26 days ago
.gitattributes
2.31 kB
987adda84827057a43027a48131fd259cdf9a756c8cee4ca7adf0d90dfa460b0
26 days ago
Mistral-Small-24B-Instruct-2501.Q2_K.gguf
8.89 GB
LFS
4c0b34d0fc3ff2c9e6b04379b64836547e7e1f2b99d7ecb8ed358445429feede
26 days ago
Mistral-Small-24B-Instruct-2501.Q3_K_L.gguf
12.4 GB
LFS
fa438cdaa313d360db90f3ab45205950b221d9cc2076673cf0b2bda174e8a75c
26 days ago
Mistral-Small-24B-Instruct-2501.Q3_K_M.gguf
11.5 GB
LFS
d9350fd9035066630a351fc56b5704f98660b2aa546e7fe1d93cc99767ae019d
26 days ago
Mistral-Small-24B-Instruct-2501.Q3_K_S.gguf
10.4 GB
LFS
f64bef4f8e9c61f497cbd71b662b6b36fcd94ec41734f939d235cb17d05318d0
26 days ago
Mistral-Small-24B-Instruct-2501.Q4_K_M.gguf
14.3 GB
LFS
2263b5df6b94aefc1822b5d41c325a84d9c215da89f3285d07de21f9cce7e797
26 days ago
Mistral-Small-24B-Instruct-2501.Q4_K_S.gguf
13.5 GB
LFS
747ff9eaf5b787e5a82851a3f8cff29ed23b61fe3314010edc7787f1e07ab533
26 days ago
Mistral-Small-24B-Instruct-2501.Q5_K_M.gguf
16.8 GB
LFS
b267a3f004de30a2b3bf36fe36416898ffb83fa184beca2d24d5cb967298d975
26 days ago
Mistral-Small-24B-Instruct-2501.Q5_K_S.gguf
16.3 GB
LFS
61f56041067ee74db3abb5f655d3c1adeb714eb9e10e47e5847ef71cd41f8daf
26 days ago
Mistral-Small-24B-Instruct-2501.Q6_K.gguf
19.3 GB
LFS
bcc5108f3a11dae5b323d8a67794969241be716719a38f14120e724534e22c12
26 days ago
Mistral-Small-24B-Instruct-2501.Q8_0.gguf
25.1 GB
LFS
987adda84827057a43027a48131fd259cdf9a756c8cee4ca7adf0d90dfa460b0
26 days ago
