Steelskull commited on
Commit
ef28eef
·
verified ·
1 Parent(s): d8964fd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +127 -29
README.md CHANGED
@@ -9,33 +9,131 @@ tags:
9
  - not-for-all-audiences
10
  ---
11
 
12
- ## Model Details
13
 
14
- ### Model Description
15
-
16
- Trained on 2 Full Epochs of Aethora-7b-V1 using [Aether-V1.9-Dataset](https://huggingface.co/datasets/TheSkullery/Aether-V1.9)
17
-
18
- Aether is a 2.5mil row (around 1 billion tokens) general use dataset with a focus in RP/Story.
19
-
20
- ### Quants
21
-
22
- Quants provided by: [N/A]() 🚀
23
-
24
- - [EXL2]()
25
-
26
- - [GGUF]()
27
-
28
- ### Model Sources
29
-
30
- - **Developed & Funded by:** [@Steelskull](https://huggingface.co/Steelskull)
31
- - **Finetuned from model:** [Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
32
- - **Finetuning Repository:** [Aether Dataset](https://huggingface.co/datasets/TheSkullery/Aether-V1.9)
33
- - **Model type:** BF16
34
- - **License:** A2
35
-
36
- ## Finetune information:
37
-
38
- - **Hardware Type:** H100 x1
39
- - **Hours used:** 60-Hrs
40
- - **Cloud Provider:** [Runpod.io](https://www.runpod.io)
41
- - **Compute Region:** US-IL
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - not-for-all-audiences
10
  ---
11
 
 
12
 
13
+ <!DOCTYPE html>
14
+ <style>
15
+ body {
16
+ font-family: 'Quicksand', sans-serif;
17
+ background: linear-gradient(135deg, #2E3440 0%, #1A202C 100%);
18
+ color: #D8DEE9;
19
+ margin: 0;
20
+ padding: 0;
21
+ font-size: 16px;
22
+ }
23
+ .container {
24
+ width: 80%;
25
+ max-width: 800px;
26
+ margin: 20px auto;
27
+ background-color: rgba(255, 255, 255, 0.02);
28
+ padding: 20px;
29
+ border-radius: 12px;
30
+ box-shadow: 0 4px 10px rgba(0, 0, 0, 0.2);
31
+ backdrop-filter: blur(10px);
32
+ border: 1px solid rgba(255, 255, 255, 0.1);
33
+ }
34
+ .header h1 {
35
+ font-size: 28px;
36
+ color: #ECEFF4;
37
+ margin: 0 0 20px 0;
38
+ text-shadow: 2px 2px 4px rgba(0, 0, 0, 0.3);
39
+ }
40
+ .info img {
41
+ width: 100%;
42
+ border-radius: 10px;
43
+ margin-bottom: 15px;
44
+ }
45
+ a {
46
+ color: #88C0D0;
47
+ text-decoration: none;
48
+ }
49
+ a:hover {
50
+ color: #A3BE8C;
51
+ }
52
+ a::before {
53
+ content: '';
54
+ position: absolute;
55
+ width: 100%;
56
+ height: 2px;
57
+ bottom: -5px;
58
+ left: 0;
59
+ background-color: #A3BE8C;
60
+ visibility: hidden;
61
+ transform: scaleX(0);
62
+ transition: all 0.3s ease-in-out;
63
+ }
64
+ a:hover::before {
65
+ visibility: visible;
66
+ transform: scaleX(1);
67
+ }
68
+ .button {
69
+ display: inline-block;
70
+ background-color: #5E81AC;
71
+ color: #E5E9F0;
72
+ padding: 10px 20px;
73
+ border-radius: 5px;
74
+ cursor: pointer;
75
+ text-decoration: none;
76
+ }
77
+ .button:hover {
78
+ background-color: #81A1C1;
79
+ }
80
+ </style>
81
+ <html lang="en">
82
+ <head>
83
+ <meta charset="UTF-8">
84
+ <meta name="viewport" content="width=device-width, initial-scale=1.0">
85
+ <title>Data Card</title>
86
+ <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet">
87
+ </head>
88
+ <body>
89
+ <div class="container">
90
+ <div class="header">
91
+ <h1>Aethora Model</h1>
92
+ </div>
93
+ <div class="info">
94
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/c0--_3VtlhfpJrmT7XBPV.png">
95
+ <p><strong>Creator:</strong> <a href="https://huggingface.co/Steelskull" target="_blank">SteelSkull</a></p>
96
+ <p><strong>About Aethora:</strong> Trained on 2 Full Epochs of Aethora-7b-V1 using Aether-V1.9 Dataset, Aethora is a model trained specifically for general use with a focus in RP/Story based on the 2.5mil row (around 1 billion tokens) Aether dataset.</p>
97
+ <p><strong>Model Quants:</strong> Quants provided by: [N/A] .</p>
98
+ <p><strong>Model Sources:</strong></p>
99
+ <ul>
100
+ <li>Developed & Funded by: <a href="https://huggingface.co/Steelskull">Steelskull</a></li>
101
+ <li>Finetuned from model: <a href="https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2">Mistral-7B-Instruct-v0.2</a></li>
102
+ <li>Finetuning Repository: <a href="https://huggingface.co/datasets/TheSkullery/Aether-V1.9">Aether Dataset</a></li>
103
+ <li>Model type: BF16</li>
104
+ <li>License: A2</li>
105
+ </ul>
106
+ <p><strong>Finetune Information:</strong></p>
107
+ <ul>
108
+ <li>Hardware Type: H100 x1</li>
109
+ <li>Hours Used: 60-Hrs</li>
110
+ <li>Cloud Provider: <a href="https://www.runpod.io">Runpod.io</a></li>
111
+ <li>Compute Region: US-IL</li>
112
+ </ul>
113
+ <p><strong>Dataset Information:</strong></p>
114
+ <ul>
115
+ <li>Version v1.9: Fixed an error where 'system' and 'tools' records were not being carried over to the final dataframe. Added an 'origins' record for dataset sources.</li>
116
+ <li>Version 1.8.5: Removed missing conversations or starting messages that are empty, and selectively omitted certain phrases for coherence and relevance.</li>
117
+ </ul>
118
+ <p><strong>Datasets Used:</strong></p>
119
+ <ul>
120
+ <li>grimulkan/bluemoon_Karen_cleaned</li>
121
+ <li>Doctor-Shotgun/no-robots-sharegpt</li>
122
+ <li>Locutusque/Hercules-v3.0</li>
123
+ <li>jondurbin/airoboros-3.2</li>
124
+ <li>openerotica/freedom-rp</li>
125
+ <li>teknium/OpenHermes-2.5</li>
126
+ <li>Doctor-Shotgun/capybara-sharegpt</li>
127
+ <li>KaraKaraWitch/PIPPA-ShareGPT-formatted</li>
128
+ <li>Locutusque/bagel-clean-v0.3-shuffled</li>
129
+ <li>Locutusque/hyperion-v3.0</li>
130
+ </ul>
131
+ <p><strong>Dataset Summary (Processed / Removed):</strong></p>
132
+ <ul>
133
+ <li>Total Objects Removed: <strong>209074</strong></li>
134
+ <li>Deduplication Stats: Starting row count: 4738917, Final row count: 2673175, Rows removed: <strong>2065742</strong></li>
135
+ </ul>
136
+ </div>
137
+ </div>
138
+ </body>
139
+ </html>