Hugging Face's logo

unsloth
/
Llama-3.2-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
English
llama
llama-3
meta
facebook
unsloth
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
ded4951
·
verified ·
1 Parent(s): 42c54c6

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +1 -0
  2. Llama-3.2-3B-Instruct-IQ4_NL.gguf +1 -1
  3. Llama-3.2-3B-Instruct-IQ4_XS.gguf +1 -1
  4. Llama-3.2-3B-Instruct-Q2_K_L.gguf +1 -1
  5. Llama-3.2-3B-Instruct-Q3_K_S.gguf +3 -0
  6. Llama-3.2-3B-Instruct-Q4_0.gguf +1 -1
  7. Llama-3.2-3B-Instruct-Q4_1.gguf +1 -1
.gitattributes CHANGED
@@ -58,3 +58,4 @@ Llama-3.2-3B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
58
  Llama-3.2-3B-Instruct-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
59
  Llama-3.2-3B-Instruct-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
60
  Llama-3.2-3B-Instruct-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
58
  Llama-3.2-3B-Instruct-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
59
  Llama-3.2-3B-Instruct-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
60
  Llama-3.2-3B-Instruct-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Llama-3.2-3B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-3B-Instruct-IQ4_NL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7fce9f7d15245e014af2fef5428cc3215047f6911d7c7bbd564acc86772b702
3
  size 1917190592
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c559cd2958092a48c7abc7175c9059ef5cdc28336ae737816a0bca8a89a4760b
3
  size 1917190592
Llama-3.2-3B-Instruct-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:142b6afcb47245ef6fee4cae18a6876cdb0b0d5f0efbba400fa7f64514ee9c40
3
  size 1829110208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fca4bfe9ebadd5a4971c8e42b9aae3ec23d7750c95647b797b8803182eab494
3
  size 1829110208
Llama-3.2-3B-Instruct-Q2_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c79a378a86d1349130d43f643203090d6451690e2aaa18e68634ec8b95ce0045
3
  size 1363935680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:162411ff9b531cb41d1204c5b81c9a52f6d2cf061c77ea645c3750cc59e9016a
3
  size 1363935680
Llama-3.2-3B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81bd392ed38532d17f8be3942ec3237747ccc9d91365e6cc31e060be3f0edac8
3
+ size 1542848960
Llama-3.2-3B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8818bdaa0dfee43f085de94677e00a84b2fe25aaff94b3789cfb57f4b6f2cf1f
3
  size 1921909184
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18eafaccbd0a63d9f2f5bd9d76e718ff57d8fc6e147d1f753f3975ac4a8938f0
3
  size 1921909184
Llama-3.2-3B-Instruct-Q4_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72ceb1fb66cfff266cb8d76ccbfabdaeaf93a712360ddf96e7b80f0802b1b3dd
3
  size 2093351360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbe13240e7f30b7c332e194efeda636c34c8afd424a27e81bda8fc848599807b
3
  size 2093351360