git commited on
Commit
8e15d84
·
1 Parent(s): 80e4f42
This view is limited to 50 files because it contains too many changes.   See raw diff
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,148 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ tags:
4
+ - mlc-llm
5
+ - web-llm
6
+ language:
7
+ - en
8
+ base_model:
9
+ - icefog72/IceNalyvkaRP-7b
10
+ pipeline_tag: text-generation
11
+ ---
12
+
13
+ This is a MLC converted weight from [IceNalyvkaRP-7b](https://huggingface.co/icefog72/IceNalyvkaRP-7b) model in MLC format `q4f16_1`.
14
+
15
+ The model can be used for projects [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
16
+
17
+ ---
18
+
19
+ # IceNalyvkaRP-7b (Ice0.70-25.01-RP)
20
+
21
+ *Nalyvka is a delightful gem from Eastern European tradition—a homemade liqueur that captures the essence of ripe fruits and the warmth of shared moments. Originating primarily in Ukraine and also cherished in Poland*
22
+
23
+
24
+ > [!IMPORTANT]
25
+ > [ST settings, rules-lorebook look here](https://huggingface.co/icefog72/GeneralInfoToStoreNotModel/tree/main/ByModel/IceNalyvkaRP)
26
+
27
+ > [!TIP]
28
+ > Get last version of rules, or ask me a questions you can
29
+ > **[here](https://discord.gg/2tJcWeMjFQ)**.
30
+ > on my new AI related discord server for feedback, questions and other stuff.
31
+
32
+ > [!NOTE]
33
+ > In general Alpaca format will work.
34
+
35
+ > [ko-fi To buy sweets for my cat :3](https://ko-fi.com/icefog72)
36
+
37
+ It shoud handle 16-25k context window, maybe 32k.
38
+
39
+
40
+ ## Exl2 Quants
41
+
42
+ > [!WARNING]
43
+ >- [4.2bpw-exl2](https://huggingface.co/icefog72/IceNalyvkaRP-7b-4.2bpw-exl2)
44
+ >- [6.5bpw-exl2](https://huggingface.co/icefog72/IceNalyvkaRP-7b-6.5bpw-exl2)
45
+ >- [8bpw-exl2](https://huggingface.co/icefog72/IceNalyvkaRP-7b-8bpw-exl2)
46
+
47
+ ## Thx mradermacher for GGUF
48
+
49
+ > [!WARNING]
50
+ >- [GGUF](https://huggingface.co/mradermacher/IceNalyvkaRP-7b-GGUF)
51
+ >- [i1-GGUF](https://huggingface.co/mradermacher/IceNalyvkaRP-7b-i1-GGUF)
52
+
53
+ ## Download
54
+
55
+ I recommend using the `huggingface-hub` Python library:
56
+
57
+ > [!TIP]
58
+ > ```shell
59
+ > pip3 install huggingface-hub
60
+ > ```
61
+
62
+ To download the `main` branch to a folder called `IceNalyvkaRP-7b`:
63
+
64
+ > [!TIP]
65
+ > ```shell
66
+ > mkdir IceNalyvkaRP-7b
67
+ > huggingface-cli download icefog72/IceNalyvkaRP-7b --local-dir IceNalyvkaRP-7b --local-dir-use-symlinks False
68
+ > ```
69
+
70
+ <details>
71
+ <summary>More advanced huggingface-cli download usage</summary>
72
+
73
+ If you remove the `--local-dir-use-symlinks False` parameter, the files will instead be stored in the central Hugging Face cache directory (default location on Linux is: `~/.cache/huggingface`), and symlinks will be added to the specified `--local-dir`, pointing to their real location in the cache. This allows for interrupted downloads to be resumed, and allows you to quickly clone the repo to multiple places on disk without triggering a download again. The downside, and the reason why I don't list that as the default option, is that the files are then hidden away in a cache folder and it's harder to know where your disk space is being used, and to clear it up if/when you want to remove a download model.
74
+
75
+ The cache location can be changed with the `HF_HOME` environment variable, and/or the `--cache-dir` parameter to `huggingface-cli`.
76
+
77
+ For more documentation on downloading with `huggingface-cli`, please see: [HF -> Hub Python Library -> Download files -> Download from the CLI](https://huggingface.co/docs/huggingface_hub/guides/download#download-from-the-cli).
78
+
79
+ To accelerate downloads on fast connections (1Gbit/s or higher), install `hf_transfer`:
80
+
81
+ ```shell
82
+ pip3 install hf_transfer
83
+ ```
84
+
85
+ And set environment variable `HF_HUB_ENABLE_HF_TRANSFER` to `1`:
86
+
87
+ ```shell
88
+ mkdir FOLDERNAME
89
+ HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download MODEL --local-dir FOLDERNAME --local-dir-use-symlinks False
90
+ ```
91
+
92
+ Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
93
+ </details>
94
+
95
+ ### Merge Method
96
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
97
+ This model was merged using the SLERP merge method.
98
+
99
+ ### Models Merged
100
+
101
+ The following models were included in the merge:
102
+ * Ice0.69-25.01-RP
103
+ * Ice0.68-25.01-RP
104
+
105
+ ### Configuration
106
+
107
+ The following YAML configuration was used to produce this model:
108
+
109
+ ```yaml
110
+ slices:
111
+ - sources:
112
+ - model: Ice0.69-25.01-RP
113
+ layer_range: [0, 32]
114
+ - model: Ice0.68-25.01-RP
115
+ layer_range: [0, 32]
116
+
117
+ merge_method: slerp
118
+ base_model: Ice0.68-25.01-RP
119
+ parameters:
120
+ t:
121
+ - filter: self_attn
122
+ value: [0, 0.5, 0.3, 0.7, 1]
123
+ - filter: mlp
124
+ value: [1, 0.5, 0.7, 0.3, 0]
125
+ - value: 0.5 # fallback for rest of tensors
126
+ dtype: bfloat16
127
+
128
+
129
+ ```
130
+
131
+ On a top of 7b MistralForCausalLM I guess? (Ice0.68-25.01-RP is less coherent )
132
+
133
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63407b719dbfe0d48b2d763b/1_JTdpDV51BDfcLKJLxAE.png)
134
+
135
+
136
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
137
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/icefog72__IceNalyvkaRP-7b-details)
138
+
139
+ | Metric |Value|
140
+ |-------------------|----:|
141
+ |Avg. |23.11|
142
+ |IFEval (0-Shot) |54.98|
143
+ |BBH (3-Shot) |32.49|
144
+ |MATH Lvl 5 (4-Shot)| 6.04|
145
+ |GPQA (0-shot) | 7.72|
146
+ |MuSR (0-shot) |15.27|
147
+ |MMLU-PRO (5-shot) |22.18|
148
+
mlc-chat-config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ffd9b0e77ac35e4dc181a92b8a6f0ccc063c523cb33278450f3cd0cb1be55e3
3
+ size 2084
ndarray-cache.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ead49ffc9595151c28902eb96ca157d87ffafe814e608e8bcd155e28ef7e7b6
3
+ size 148166
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c856bec2c2d9b57465edf29a82573a6dcd950952812cb1bb48646d7451ea82c
3
+ size 65536000
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1710d50f500c2827a1bfe3aa02ded497b16018921da5fe6141768649e3a88fdb
3
+ size 65536000
params_shard_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b44c157cde704845f8064de7922fb92601597bba76ca02884f5d87f789c122e
3
+ size 58720256
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:922ed3fcec28520c58de85ea916cfb308ee652b40b488da2859ebb490cda48e7
3
+ size 30949376
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:312223140ab2d68cda019200f3da2f50a6f2d601d7cdfa1d8e1db67e66ed6826
3
+ size 58720256
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc0d2ef99a08928f35238050057a01fafea8964b55501a8b37e8b0273376b030
3
+ size 25174016
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d334b72555b0b8879c2b714bc7125b3f25955cdb559d54aaaf77eb6f46ac206
3
+ size 29360128
params_shard_104.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7748f1d8eea64c75ba0335ef96ca6e61ade3f6d455e2d960395e9c98b766fd24
3
+ size 58720256
params_shard_105.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:960c2fba9a030d75dc6ee29522fdf8c08ebc349c91edf01ede9ec4e64c250e8e
3
+ size 33046528
params_shard_106.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15e81c550ef0ee8a5b379e51c1144d136ee77691db20be4250b53a24b2033928
3
+ size 11018240
params_shard_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de77ab8a78df985c1b4f2a965ae8c6d32067e6b211bda4ee3fc37343aca93e28
3
+ size 25174016
params_shard_12.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6c91bf23336f24ce771a68502c328ce0ca68549ba0c509b0d6a2d7b8f2fbfea
3
+ size 29360128
params_shard_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3635bc2682bd0815eb18354f1c598395b127cdcc6f11944400791f0575446b26
3
+ size 58720256
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ded437ed27b870f7d330b9072e8ae762b2216c3df4dea7a742fe420498b154b
3
+ size 33046528
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcd873d2be4c245bdbbc0d734de542b3e38868a2cae8553cc3380d947a14ea70
3
+ size 29360128
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d98dcb0d5fc3485cda198b7e010298ea679f39b1688a8670f8f43fe124b22e4
3
+ size 58720256
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a40a1d8c45af63ba954980d78e74f027039208a35fa67878a7f521b9c57790bf
3
+ size 22036480
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af56b61d1a4fa65c0806ef5d2548b97bbdd620ed81e796b5e04ff334ec731394
3
+ size 29360128
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcfabedc7de73ee94c389ce10f2fd9792eb884032d545e115f2265c3f380f7af
3
+ size 58720256
params_shard_2.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be7cc369ea53b0f2f7e75d95444dff3f64cccdacf458310e249bd8abeb7be232
3
+ size 29360128
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fa11cc715395b66a62ad24c38bd5edf4472bec86ef7a3c5c5ea575a4c890d02
3
+ size 27271168
params_shard_21.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:808bdf03cace483f9f425f8a8d4c05ce885e1ba3c33601a0ca1197d46fc99a89
3
+ size 29360128
params_shard_22.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e7f2f14c5a6635429b4f812cfd81edc5d24a3e85b901a05f0ace79084b197fa
3
+ size 30949376
params_shard_23.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5db80a0017a9417ce1ac274668a0a6416780b6ec91aadd3f20c109e3c79799ac
3
+ size 58720256
params_shard_24.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5a28b9cab037c7e1bbd6b3e87a40648b4333603847a256274547d750295ae58
3
+ size 25174016
params_shard_25.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c7151d6aab12802ac67748b6ecde324208a51cf977114f97382d1e5dfa20b92
3
+ size 29360128
params_shard_26.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2328ca1b98cddbc94b80da9e22e63ce353d0663b18e45140566fc6248f031ca5
3
+ size 58720256
params_shard_27.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb99a8c1065511002fa90939337a3b88a39a993def729d9121e779eeeeb1b58a
3
+ size 33046528
params_shard_28.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccbfba38fc32e0977bdc3790cc78436813f12038bbe3d06dbde719bae31b358b
3
+ size 29360128
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eebd0639f311db90f792f4dcd3b32a6cee489bac8ba39c65472b09835f6c5c18
3
+ size 58720256
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7e61b156c80d70b553c7be94051a32ab602c58b331920fc3d111aa1665e264c
3
+ size 58720256
params_shard_30.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93f7c0fc25352964d3640f93cbd84de98d37f3a768149b0c0e453e5c402985e2
3
+ size 22036480
params_shard_31.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d13fd2b93912b0e8b9fce410afcc0668f2f28555ef3a285925c3d391fb2c36e9
3
+ size 29360128
params_shard_32.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd58664f401d4ef1b77f8067499a6040986afbe51534d47b575a58fef38413ee
3
+ size 58720256
params_shard_33.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac1c046e91f08fff1a30a1f111b1f7c116ee27732acc917be5de7407eeccf1f6
3
+ size 27271168
params_shard_34.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15c876853eb9a64809bf9efed28bfc60f94ee021f6458659a1b770630fd25fa6
3
+ size 29360128
params_shard_35.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beb076f08a205652ecd004730533e3402216021a8a0c070a3e04beea546c534e
3
+ size 30949376
params_shard_36.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a9c59e9bbfab59d449349ecc6035a2c1701bd529a79a63bb5e6cc5b935c91d0
3
+ size 58720256
params_shard_37.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d64c79903965d95b13f5cdd4f7435df6d389cd623b5b0b8a5788c81836e319da
3
+ size 25174016
params_shard_38.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7becd4624d2900eb432e1499893c65d12e6cdd569a19789b3591b3042e0228b2
3
+ size 29360128
params_shard_39.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36b7db491b3ddc08c918ab6ed57db2b3cac0216a4aa831c5455a4dcd61395404
3
+ size 58720256
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f65ae1491e6d1e2d81bb14bb4b386c5d5a8f2987edaa7516dc171f0c6e792d96
3
+ size 27410432
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2783df2811c499e6cd6cd31f63c7606e8f11165d0c71db7648433868ddbca7ba
3
+ size 33046528
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b60fd367f7c5e51a0cf8836063ac53bb2d73126e7de5785fd5f2c1bb1fafa8dc
3
+ size 29360128
params_shard_42.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:675df204b4742b8ae77fd8ddab405a1a969f9b99e926a7e0e8e0db374f87a5ef
3
+ size 58720256
params_shard_43.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c1086d99c8361bd9d1d370cbf9502ec101f902a831fa414fa8b202355e0dbe5
3
+ size 22036480