Update README.md

README.md

@@ -11,41 +11,36 @@ tags:
 
 Listen to the song on youtube: https://www.youtube.com/watch?v=npyiiInMA0w
 
-<iframe width="1280" height="895" src="https://www.youtube.com/embed/npyiiInMA0w" title="Take the Journey" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
+This is my second attempt at a model merge, This time, these models were used
 
-Soo... after I failed the first time, I took a crack at merging again. This time, these models were used
+- mistralai/Mistral-Nemo-Base-2407
+- Sao10K/MN-12B-Lyra-v4
+- nothingiisreal/MN-12B-Starcannon-v2
+- Gryphe/Pantheon-RP-1.5-12b-Nemo
 
-mistralai/Mistral-Nemo-Base-2407
-Sao10K/MN-12B-Lyra-v4
-nothingiisreal/MN-12B-Starcannon-v2
-Gryphe/Pantheon-RP-1.5-12b-Nemo
+License for this model is: Apache 2.0 (due to the base model, Mistral Nemo Base 2407)
 
-License for this model is: cc-by-nc-4.0
+Intended Use case: Roleplay
 
-
-TO CLEAR SOME CONFUSION: Please use ChatML
-~~I hope this was worth the time I spent to create this merge, lol~~
-
-Gated access for now, gated access will be disabled when testing is done, and thanks to all who have interest.
+Instruction Format: ChatML
 
 Thank you to AuriAetherwiing for helping me merge the models.
 
-Details
-
+# Data?
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+This is a hard question to answer, I didn't add any data to the model itself, rather it's a merge of other models, so the data used for them applies to this model too, though it won't be the same.
 
 ## Merge Details
 ### Merge Method
 
-This model was merged using the della_linear merge method using C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\mistralai_Mistral-Nemo-Base-2407 as a base.
+This model was merged using the della_linear merge method using mistralai/Mistral-Nemo-Base-2407 as a base.
 
 ### Models Merged
 
 The following models were included in the merge:
-* C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\Sao10K_MN-12B-Lyra-v4
-* C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\Gryphe_Pantheon-RP-1.5-12b-Nemo
-* C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\nothingiisreal_MN-12B-Starcannon-v2
+* Sao10K/MN-12B-Lyra-v4
+* Gryphe/Pantheon-RP-1.5-12b-Nemo
+* nothingiisreal/MN-12B-Starcannon-v2
 
 ### Configuration
 
@@ -73,3 +68,10 @@ parameters:
 merge_method: della_linear
 dtype: bfloat16
 ```
+
+## Notes
+
+Della_Linear: Refer to https://arxiv.org/abs/2406.11617 and https://arxiv.org/abs/2212.04089, as it is quite long to explain what Della_Linear is
+BFloat16: Brain Floating Point 16, a way to run models faster on Nvidia GPUs
+Density: Fraction of weights in differences from the base model to retain
+Epsilon: Maximum change in drop probability based on magnitude. Drop probabilities assigned will range