Hugging Face's logo

huggingkot
/
Lumimaid-v0.2-8B-q4f16_1-MLC

Text Generation
MLC-LLM
English
web-llm
Not-For-All-Audiences
nsfw
Model card Files Community
git commited on
Commit
e952af3
·
1 Parent(s): dc13f2a

add files

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +1 -0
  2. README.md +101 -0
  3. mlc-chat-config.json +3 -0
  4. ndarray-cache.json +3 -0
  5. params_shard_0.bin +3 -0
  6. params_shard_1.bin +3 -0
  7. params_shard_10.bin +3 -0
  8. params_shard_100.bin +3 -0
  9. params_shard_101.bin +3 -0
  10. params_shard_102.bin +3 -0
  11. params_shard_103.bin +3 -0
  12. params_shard_104.bin +3 -0
  13. params_shard_105.bin +3 -0
  14. params_shard_106.bin +3 -0
  15. params_shard_107.bin +3 -0
  16. params_shard_11.bin +3 -0
  17. params_shard_12.bin +3 -0
  18. params_shard_13.bin +3 -0
  19. params_shard_14.bin +3 -0
  20. params_shard_15.bin +3 -0
  21. params_shard_16.bin +3 -0
  22. params_shard_17.bin +3 -0
  23. params_shard_18.bin +3 -0
  24. params_shard_19.bin +3 -0
  25. params_shard_2.bin +3 -0
  26. params_shard_20.bin +3 -0
  27. params_shard_21.bin +3 -0
  28. params_shard_22.bin +3 -0
  29. params_shard_23.bin +3 -0
  30. params_shard_24.bin +3 -0
  31. params_shard_25.bin +3 -0
  32. params_shard_26.bin +3 -0
  33. params_shard_27.bin +3 -0
  34. params_shard_28.bin +3 -0
  35. params_shard_29.bin +3 -0
  36. params_shard_3.bin +3 -0
  37. params_shard_30.bin +3 -0
  38. params_shard_31.bin +3 -0
  39. params_shard_32.bin +3 -0
  40. params_shard_33.bin +3 -0
  41. params_shard_34.bin +3 -0
  42. params_shard_35.bin +3 -0
  43. params_shard_36.bin +3 -0
  44. params_shard_37.bin +3 -0
  45. params_shard_38.bin +3 -0
  46. params_shard_39.bin +3 -0
  47. params_shard_4.bin +3 -0
  48. params_shard_40.bin +3 -0
  49. params_shard_41.bin +3 -0
  50. params_shard_42.bin +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,101 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ tags:
4
+ - mlc-llm
5
+ - web-llm
6
+ - not-for-all-audiences
7
+ - nsfw
8
+ language:
9
+ - en
10
+ base_model:
11
+ - NeverSleep/Lumimaid-v0.2-8B
12
+ pipeline_tag: text-generation
13
+ ---
14
+
15
+ This is a MLC converted weight from [Lumimaid-v0.2-8B](https://huggingface.co/NeverSleep/Lumimaid-v0.2-8B) model in MLC format `q4f16_1`.
16
+
17
+ The model can be used for projects [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
18
+
19
+ ---
20
+
21
+ ## Lumimaid 0.2
22
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/63ab1241ad514ca8d1430003/TUcHg7LKNjfo0sni88Ps7.png" alt="Image" style="display: block; margin-left: auto; margin-right: auto; width: 65%;">
23
+ <div style="text-align: center; font-size: 30px;">
24
+ <a href="https://huggingface.co/NeverSleep/Lumimaid-v0.2-8B">[8b]</a> -
25
+ <a href="https://huggingface.co/NeverSleep/Lumimaid-v0.2-12B">12b</a> -
26
+ <a href="https://huggingface.co/NeverSleep/Lumimaid-v0.2-70B">70b</a> -
27
+ <a href="https://huggingface.co/NeverSleep/Lumimaid-v0.2-123B">123b</a>
28
+ </div>
29
+
30
+ ### This model is based on: [Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct)
31
+ Wandb: https://wandb.ai/undis95/Lumi-Llama-3-1-8B?nw=nwuserundis95
32
+
33
+ Lumimaid 0.1 -> 0.2 is a HUGE step up dataset wise.
34
+
35
+ As some people have told us our models are sloppy, Ikari decided to say fuck it and literally nuke all chats out with most slop.
36
+
37
+ Our dataset stayed the same since day one, we added data over time, cleaned them, and repeat. After not releasing model for a while because we were never satisfied, we think it's time to come back!
38
+
39
+
40
+ ## Prompt template: Llama-3-Instruct
41
+
42
+ ```
43
+ <|begin_of_text|><|start_header_id|>system<|end_header_id|>
44
+
45
+ {system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
46
+
47
+ {input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
48
+
49
+ {output}<|eot_id|>
50
+ ```
51
+
52
+ ## Credits:
53
+ - Undi
54
+ - IkariDev
55
+
56
+ ## Training data we used to make our dataset:
57
+
58
+ - [Epiculous/Gnosis](https://huggingface.co/Epiculous/Gnosis)
59
+ - [ChaoticNeutrals/Luminous_Opus](https://huggingface.co/datasets/ChaoticNeutrals/Luminous_Opus)
60
+ - [ChaoticNeutrals/Synthetic-Dark-RP](https://huggingface.co/datasets/ChaoticNeutrals/Synthetic-Dark-RP)
61
+ - [ChaoticNeutrals/Synthetic-RP](https://huggingface.co/datasets/ChaoticNeutrals/Synthetic-RP)
62
+ - [Gryphe/Sonnet3.5-SlimOrcaDedupCleaned](https://huggingface.co/datasets/Gryphe/Sonnet3.5-SlimOrcaDedupCleaned)
63
+ - [Gryphe/Opus-WritingPrompts](https://huggingface.co/datasets/Gryphe/Opus-WritingPrompts)
64
+ - [meseca/writing-opus-6k](https://huggingface.co/datasets/meseca/writing-opus-6k)
65
+ - [meseca/opus-instruct-9k](https://huggingface.co/datasets/meseca/opus-instruct-9k)
66
+ - [PJMixers/grimulkan_theory-of-mind-ShareGPT](https://huggingface.co/datasets/PJMixers/grimulkan_theory-of-mind-ShareGPT)
67
+ - [NobodyExistsOnTheInternet/ToxicQAFinal](https://huggingface.co/datasets/NobodyExistsOnTheInternet/ToxicQAFinal)
68
+ - [Undi95/toxic-dpo-v0.1-sharegpt](https://huggingface.co/datasets/Undi95/toxic-dpo-v0.1-sharegpt)
69
+ - [cgato/SlimOrcaDedupCleaned](https://huggingface.co/datasets/cgato/SlimOrcaDedupCleaned)
70
+ - [kalomaze/Opus_Instruct_25k](https://huggingface.co/datasets/kalomaze/Opus_Instruct_25k)
71
+ - [Doctor-Shotgun/no-robots-sharegpt](https://huggingface.co/datasets/Doctor-Shotgun/no-robots-sharegpt)
72
+ - [Norquinal/claude_multiround_chat_30k](https://huggingface.co/datasets/Norquinal/claude_multiround_chat_30k)
73
+ - [nothingiisreal/Claude-3-Opus-Instruct-15K](https://huggingface.co/datasets/nothingiisreal/Claude-3-Opus-Instruct-15K)
74
+ - All the Aesirs dataset, cleaned, unslopped
75
+ - All le luminae dataset, cleaned, unslopped
76
+ - Small part of Airoboros reduced
77
+
78
+ We sadly didn't find the sources of the following, DM us if you recognize your set !
79
+
80
+ - Opus_Instruct-v2-6.5K-Filtered-v2-sharegpt
81
+ - claude_sharegpt_trimmed
82
+ - CapybaraPure_Decontaminated-ShareGPT_reduced
83
+
84
+ ## Datasets credits:
85
+ - Epiculous
86
+ - ChaoticNeutrals
87
+ - Gryphe
88
+ - meseca
89
+ - PJMixers
90
+ - NobodyExistsOnTheInternet
91
+ - cgato
92
+ - kalomaze
93
+ - Doctor-Shotgun
94
+ - Norquinal
95
+ - nothingiisreal
96
+
97
+ ## Others
98
+
99
+ Undi: If you want to support us, you can [here](https://ko-fi.com/undiai).
100
+
101
+ IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek
mlc-chat-config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71cf20523b7e93554f01c06f6f6bb9764dd6d747aa9771e166b51a35f366d62c
3
+ size 2349
ndarray-cache.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3cf6f2a911d2b010a83b4a0821bcda46b02d3b44c5a91000db5d205ee31de290
3
+ size 148396
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:113a26abd0db991ca3795591ad82a30d03dfd75e7b71e3366400446ad0634f64
3
+ size 262668288
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10be0fd05a377773b67a2d44015609407ad205d663ed9c2e76dfdaecb9960778
3
+ size 29360128
params_shard_10.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1906227e082e3e03de710054cf1df3f362a20d4a6a1e2b8eef3fa6f3d6a676cf
3
+ size 33046528
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f78292cae5768afbf2896c728886f413536c85b935b130d2bccbdab05db00d22
3
+ size 58720256
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2346c580c8e01c1b5a1505a0f391c9311f79772d17b2fa9ce86321933f8149b2
3
+ size 25174016
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea546b0e7bbacbde651a5ca0a5f53edf0362f45b748ba1cf948583c69fdc21b9
3
+ size 29360128
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5cefb285fcb32bd8e6b977384d68d648244a69c25c25e1c6c438c9546704bace
3
+ size 58720256
params_shard_104.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9312c77a9b6822fe3a5f5a36e45ffb1ec81a5b441a394b67b180fc62b1903084
3
+ size 33046528
params_shard_105.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf0ca08b191ad19c70fa36a9835f0f872641e7aa36174f3e675c378501aaa019
3
+ size 58720256
params_shard_106.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f6a3168e6c683d0d01a02f051e3f2b2fe7028803752e527553f4d5c7ac2e7cb
3
+ size 32505856
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39a727ce295b6f8fd00a2589a54fde770b1153606ee4cc740083b0e1f6d567c9
3
+ size 9437184
params_shard_11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38396fb890ff43df27950af1e90c8f2e3b1fc0c9322bf4a82188b5952e6f7fc0
3
+ size 29360128
params_shard_12.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:749d9b5a1498ce4d2bed758fefc0a6c1276edb4e2f9c4c6ae386df44d570ac83
3
+ size 58720256
params_shard_13.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4027caab358cf4fbf79b6ef748baaa25d30a0357056f1928928f7d5646c9347b
3
+ size 22036480
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6076d861409aaa59e9749ff5ccf3aa03186f92f59265376a05beb1999966d96
3
+ size 29360128
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d02ad613d54865a891c646bef1dff91a12e893adc78e0fe69de0ea0ed75dacfe
3
+ size 58720256
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57ef2cb0af689dd141b354985d1a09db23a6e43a8fc460bece2bf44fc38910d8
3
+ size 27271168
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6f7b8eae6ff662aab64aa61ba0e629e1cb72549fe734c07ea9f606224fc52c2
3
+ size 29360128
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38b4f4d79a9988f05a0f32c1c8959dba841742d24dcdf66ea7b14eb0c3e6851f
3
+ size 30949376
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:280737c74caefa308b14d7864969ef31504e407669d4748ee0e7cf194c9d75aa
3
+ size 58720256
params_shard_2.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a8306a671316c84c565b3e708418adae99abff1bb807010f20cbb54a416615f0
3
+ size 32841728
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9af417338d4a23a6c85bcf611121fa094b4dc403b4684df9d27d81932850de33
3
+ size 25174016
params_shard_21.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00b4aa09c466738192ce75b46bbd681201a9f2991b08d870d81755600e68c50e
3
+ size 29360128
params_shard_22.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42ac200227fcb472ede273a5eec7edcbdb5cce2058019b80dfdbe1a8966aabb8
3
+ size 58720256
params_shard_23.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:474e29a7d0daf1aef648ced1e3cb58678493ee2d5a4328f94d3a0f16bcbdca9a
3
+ size 33046528
params_shard_24.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b8bbac6370a18a8bc92a508e2dcb13975da1753a5f46c5db4680c3841baa88a
3
+ size 29360128
params_shard_25.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c64558f1aa1851ef3ba21a63334485b338546801f068d7519d4c79398c7c15c
3
+ size 58720256
params_shard_26.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:503b4368ce1ecc26bea9852020d121993133fb3c3fba2b1bc54ce91957c8d58e
3
+ size 22036480
params_shard_27.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f0f9fb6c0b2f0520c692c56adee4a8c32aa773edbbd9f1f5a0a3f5cf8027a0c
3
+ size 29360128
params_shard_28.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:794d802094fe35b70c62b60d217f8779e8445145425224646d559c0cab93e33a
3
+ size 58720256
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2694e1952926f5a9e51089503b1e7bf77be3adb72cc69a7fe03c78743e2a601
3
+ size 27271168
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8895a8f3442996fbd13e0ab959786bba197d1fc28ff315ed2eb6fce53bf9095f
3
+ size 262668288
params_shard_30.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03ba881c4da4618f9a6c9acf7fd8b0a18f84d89f7b9169adbd720182e9f9ad04
3
+ size 29360128
params_shard_31.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1a3401d9bcd8a9a437a02e56ce0a3b4db63d45a3675fb3515d8df95213b690a
3
+ size 30949376
params_shard_32.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:449214a573732d7540c593c05920c29961f3473cd152759eadd7bcff25a15e02
3
+ size 58720256
params_shard_33.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:847cd949c5fb99a1822903d07191406fa0ce2fa7e963337e541c831d58425b4b
3
+ size 25174016
params_shard_34.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:210600fda3707526b76967c50984fa10b8195781434724050c479cc10956af0a
3
+ size 29360128
params_shard_35.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2effdf607aae4d9ccd6d980841e4920e83b8cced0efd4548a33b0853fb31707c
3
+ size 58720256
params_shard_36.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b3dd34b0b0d8e549cfc7ad4bc4ec71b4c483f9a1db075855a3c270518985033
3
+ size 33046528
params_shard_37.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2b54b893a0f04809254729257e15ba2e4469c07c70436f6f2b0a35e74216fb2
3
+ size 29360128
params_shard_38.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abbac70fff26478e3788d4d46b1c427d9653fb94b0d1f54dd378e78cf435ed84
3
+ size 58720256
params_shard_39.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c87d6f1b6ce100f3dd4457327994177e4e8966f828ad5cf6400a64003376a53a
3
+ size 22036480
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69a75180704b8d62bef513f3ef57d7cd36803c111354be6caf9531485d805f6a
3
+ size 32833536
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7375502f1ade9f5a5f7d83682f21bc2752941d631225219136b6c3dbda142fb
3
+ size 29360128
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8bdc57b6ef0357863b267b829625b01653df5f4f1fff1e33d1429b66180d6fe
3
+ size 58720256
params_shard_42.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09bf3280cdc9c16d5f78197f85b7a9ef03a21fb98cd8dc2108453ec6c1a0954c
3
+ size 27271168