Mungert
/

SmallThinker-21BA3B-Instruct-GGUF

Text Generation

Mixture of Experts

Model card Files Files and versions

SmallThinker-21BA3B-Instruct-GGUF

Ctrl+K

Ctrl+K

2 contributors

History: 30 commits

johnbridges's picture

Upload SmallThinker-21BA3B-Instruct-iq2_s.gguf with huggingface_hub

065aacb verified about 1 month ago

.gitattributes

3.74 kB

Upload SmallThinker-21BA3B-Instruct-iq2_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-bf16_q8_0.gguf

24.1 GB
xet

Upload SmallThinker-21BA3B-Instruct-bf16_q8_0.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-f16.gguf

43 GB
xet

Upload SmallThinker-21BA3B-Instruct-f16.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-f16_q8_0.gguf

24.1 GB
xet

Upload SmallThinker-21BA3B-Instruct-f16_q8_0.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-iq1_m.gguf

6.21 GB
xet

Upload SmallThinker-21BA3B-Instruct-iq1_m.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-iq1_s.gguf

5.7 GB
xet

Upload SmallThinker-21BA3B-Instruct-iq1_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_s.gguf

7.48 GB
xet

Upload SmallThinker-21BA3B-Instruct-iq2_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_xs.gguf

6.95 GB
xet

Upload SmallThinker-21BA3B-Instruct-iq2_xs.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-iq2_xxs.gguf

6.51 GB
xet

Upload SmallThinker-21BA3B-Instruct-iq2_xxs.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_l.gguf

8.4 GB
xet

Upload SmallThinker-21BA3B-Instruct-q2_k_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_m.gguf

8.21 GB
xet

Upload SmallThinker-21BA3B-Instruct-q2_k_m.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q2_k_s.gguf

8.17 GB
xet

Upload SmallThinker-21BA3B-Instruct-q2_k_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q3_k_m.gguf

10.9 GB
xet

Upload SmallThinker-21BA3B-Instruct-q3_k_m.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q3_k_s.gguf

10.7 GB
xet

Upload SmallThinker-21BA3B-Instruct-q3_k_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q4_0.gguf

12.1 GB
xet

Upload SmallThinker-21BA3B-Instruct-q4_0.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q4_0_l.gguf

12.5 GB
xet

Upload SmallThinker-21BA3B-Instruct-q4_0_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q4_1.gguf

13.5 GB
xet

Upload SmallThinker-21BA3B-Instruct-q4_1.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q4_1_l.gguf

13.8 GB
xet

Upload SmallThinker-21BA3B-Instruct-q4_1_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q4_k_m.gguf

13.6 GB
xet

Upload SmallThinker-21BA3B-Instruct-q4_k_m.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q4_k_s.gguf

12.9 GB
xet

Upload SmallThinker-21BA3B-Instruct-q4_k_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_0.gguf

14.8 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_0.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_0_l.gguf

15.1 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_0_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_1.gguf

16.2 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_1.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_1_l.gguf

16.4 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_1_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_k_l.gguf

16 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_k_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_k_m.gguf

15.8 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_k_m.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q5_k_s.gguf

15.5 GB
xet

Upload SmallThinker-21BA3B-Instruct-q5_k_s.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q6_k_l.gguf

17.9 GB
xet

Upload SmallThinker-21BA3B-Instruct-q6_k_l.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q6_k_m.gguf

17.7 GB
xet

Upload SmallThinker-21BA3B-Instruct-q6_k_m.gguf with huggingface_hub about 1 month ago
SmallThinker-21BA3B-Instruct-q8_0.gguf

22.9 GB
xet

Upload SmallThinker-21BA3B-Instruct-q8_0.gguf with huggingface_hub about 1 month ago