Hugging Face's logo

tsunemoto
/
Metis-0.4-GGUF

GGUF
English
GGUF
Inference Endpoints
conversational
Model card Files Community
tsunemoto commited on
Commit
f2d2cdb
·
1 Parent(s): fe8fa30

Upload folder using huggingface_hub

Browse files
Files changed (16) hide show
  1. .gitattributes +14 -0
  2. README.md +56 -0
  3. metis-0.4.Q2_K.gguf +3 -0
  4. metis-0.4.Q3_K_L.gguf +3 -0
  5. metis-0.4.Q3_K_M.gguf +3 -0
  6. metis-0.4.Q3_K_S.gguf +3 -0
  7. metis-0.4.Q4_0.gguf +3 -0
  8. metis-0.4.Q4_1.gguf +3 -0
  9. metis-0.4.Q4_K_M.gguf +3 -0
  10. metis-0.4.Q4_K_S.gguf +3 -0
  11. metis-0.4.Q5_0.gguf +3 -0
  12. metis-0.4.Q5_1.gguf +3 -0
  13. metis-0.4.Q5_K_M.gguf +3 -0
  14. metis-0.4.Q5_K_S.gguf +3 -0
  15. metis-0.4.Q6_K.gguf +3 -0
  16. metis-0.4.Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,17 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ metis-0.4.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ metis-0.4.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ metis-0.4.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ metis-0.4.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ metis-0.4.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ metis-0.4.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
42
+ metis-0.4.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ metis-0.4.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ metis-0.4.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ metis-0.4.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
46
+ metis-0.4.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ metis-0.4.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ metis-0.4.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ metis-0.4.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Metis-0.4 Quantized in GGUF"
3
+ tags:
4
+ - GGUF
5
+ language: en
6
+ ---
7
+ ![Image description](https://i.postimg.cc/MGwhtFfF/tsune-fixed.png)
8
+
9
+ # Tsunemoto GGUF's of Metis-0.4
10
+
11
+ This is a GGUF quantization of Metis-0.4.
12
+
13
+ ## Original Repo Link:
14
+ [Original Repository](https://huggingface.co/Mihaiii/Metis-0.4)
15
+
16
+ ## Original Model Card:
17
+ ---
18
+
19
+ This is a merge between Metis-0.3 and Metis-0.1 having Metis-0.1 as base.
20
+ It was done using [mergekit](https://github.com/cg123/mergekit).
21
+
22
+ It works well with long system prompts.
23
+
24
+ It isn't generic in a sense that it shouldn't be used for story telling, for example, but only for reasoning and text comprehension.
25
+
26
+ This model is trained on a private dataset. The high GSM8K score is **NOT** because of the MetaMath dataset.
27
+
28
+ # Prompt Format:
29
+
30
+ ```
31
+ <|system|>
32
+ {system_message} </s>
33
+ <|user|>
34
+ {prompt} </s>
35
+ <|assistant|>
36
+ ```
37
+
38
+ Merge config:
39
+ ```yaml
40
+ slices:
41
+ - sources:
42
+ - model: Mihaiii/Metis-0.3
43
+ layer_range: [0, 32]
44
+ - model: Mihaiii/Metis-0.1
45
+ layer_range: [0, 32]
46
+ merge_method: slerp
47
+ base_model: Mihaiii/Metis-0.1
48
+ parameters:
49
+ t:
50
+ - filter: self_attn
51
+ value: [0, 0.5, 0.3, 0.7, 1]
52
+ - filter: mlp
53
+ value: [1, 0.5, 0.7, 0.3, 0]
54
+ - value: 0.5 # fallback for rest of tensors
55
+ dtype: bfloat16
56
+ ```
metis-0.4.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5c3703720078ed625d9f017c838a76db91deb41f15fe61131336b2b2879ad5f
3
+ size 3084034624
metis-0.4.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60055b8cf1c240dabe22487980ecfb9dfe3cfd8cc6f05d37c353448ae6e5ce8c
3
+ size 3822961216
metis-0.4.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:620eda777a1c6f986ed30ea7fa1bcf7df9d33fa22d5507b3ff5a1b2e5c3d4f45
3
+ size 3519922752
metis-0.4.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb3cd60facd085564fe5203506418bcafb5ec67a0378b9561395bc088da66668
3
+ size 3165504064
metis-0.4.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:575a9adbf71500f85aa3e707e709b8d02dedd75ec717d215886e0a7bedcd1096
3
+ size 4109853248
metis-0.4.Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:779c8434fe54c184a2d6a106b659e010d6e23bb05c4125ab3dd306e96257f8bc
3
+ size 4554252864
metis-0.4.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:062702cd85cf75d2560ba91b1197a2a052342f31df036c908996f1e22bf98181
3
+ size 4369375808
metis-0.4.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77bfbf6255d8acc0aacc4e5cdaebc9c0b7b5d623f85279ca76d47dc02ca4cd91
3
+ size 4141310528
metis-0.4.Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00be21cbbb2b0b36f4acb633ab349fc332ca56c8304f5dad74713f6c0d5e0e3a
3
+ size 4998652480
metis-0.4.Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bd49554c09a6d4d742b9523f04d90a02847c6aecf13e24a38c23c08b17340a9
3
+ size 5443052096
metis-0.4.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22f8e850eab432d28a31e667ba7f73b95df119a654de5be8c72e8f09c1837f44
3
+ size 5132345920
metis-0.4.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63a2ecadea63cb05085ce96238791116a91cd858ae21b9da34f2557c5c7e7781
3
+ size 4998652480
metis-0.4.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b98eb4520eec07608d4e3dcbb1da830526f04d285ff7b8dd645a1a03b2ed838
3
+ size 5943001664
metis-0.4.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c24a2fcaeba7a36777c0b2ebc0d316b666f3c765e3fcf3d682428c78413bd59
3
+ size 7696794176