Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
SmallThinker-21BA3B-Instruct-GGUF
like
2
Text Generation
Transformers
GGUF
English
Mixture of Experts
conversational
arxiv:
2507.20984
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Train
Deploy
Use this model
ae451e6
SmallThinker-21BA3B-Instruct-GGUF
Ctrl+K
Ctrl+K
2 contributors
History:
10 commits
johnbridges
Upload SmallThinker-21BA3B-Instruct-q3_k_m.gguf with huggingface_hub
ae451e6
verified
about 1 month ago
.gitattributes
2.21 kB
Upload SmallThinker-21BA3B-Instruct-q3_k_m.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-bf16_q8_0.gguf
Safe
24.1 GB
xet
Upload SmallThinker-21BA3B-Instruct-bf16_q8_0.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-f16.gguf
Safe
43 GB
xet
Upload SmallThinker-21BA3B-Instruct-f16.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-f16_q8_0.gguf
Safe
24.1 GB
xet
Upload SmallThinker-21BA3B-Instruct-f16_q8_0.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_l.gguf
Safe
8.4 GB
xet
Upload SmallThinker-21BA3B-Instruct-q2_k_l.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_m.gguf
Safe
8.21 GB
xet
Upload SmallThinker-21BA3B-Instruct-q2_k_m.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_s.gguf
Safe
8.17 GB
xet
Upload SmallThinker-21BA3B-Instruct-q2_k_s.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-q3_k_m.gguf
Safe
10.9 GB
xet
Upload SmallThinker-21BA3B-Instruct-q3_k_m.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-q5_k_l.gguf
Safe
16 GB
xet
Upload SmallThinker-21BA3B-Instruct-q5_k_l.gguf with huggingface_hub
about 1 month ago
SmallThinker-21BA3B-Instruct-q6_k_l.gguf
Safe
17.9 GB
xet
Upload SmallThinker-21BA3B-Instruct-q6_k_l.gguf with huggingface_hub
about 1 month ago
