neody
/

Llama-3.1-Swallow-8B-v0.5-gguf

Model card Files Files and versions

Llama-3.1-Swallow-8B-v0.5-gguf

Ctrl+K

Ctrl+K

1 contributor

History: 16 commits

googlefan's picture

Upload llama-3.1-swallow-8b-v0.5-iq4_xs.gguf with huggingface_hub

c2f03ee verified 2 months ago

.gitattributes

2.52 kB

Upload llama-3.1-swallow-8b-v0.5-iq4_xs.gguf with huggingface_hub 2 months ago
README.md

123 Bytes

Create README.md 2 months ago
imatrix.dat

4.99 MB
xet

Upload imatrix.dat with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-bf16.gguf

16.1 GB
xet

Upload llama-3.1-swallow-8b-v0.5-bf16.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-iq3_m.gguf

3.78 GB
xet

Upload llama-3.1-swallow-8b-v0.5-iq3_m.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-iq4_nl.gguf

4.68 GB
xet

Upload llama-3.1-swallow-8b-v0.5-iq4_nl.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-iq4_xs.gguf

4.45 GB
xet

Upload llama-3.1-swallow-8b-v0.5-iq4_xs.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q3_k_l.gguf

4.32 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q3_k_l.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q3_k_m.gguf

4.02 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q3_k_m.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q3_k_s.gguf

3.66 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q3_k_s.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q4_k_m.gguf

4.92 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q4_k_m.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q4_k_s.gguf

4.69 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q4_k_s.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q5_k_m.gguf

5.73 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q5_k_m.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q5_k_s.gguf

5.6 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q5_k_s.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q6_k.gguf

6.6 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q6_k.gguf with huggingface_hub 2 months ago
llama-3.1-swallow-8b-v0.5-q8_0.gguf

8.54 GB
xet

Upload llama-3.1-swallow-8b-v0.5-q8_0.gguf with huggingface_hub 2 months ago