Update README.md
Browse files
README.md
CHANGED
@@ -28,8 +28,8 @@ base_model:
|
|
28 |
<p>Aura-llama is using the methodology presented by SOLAR for scaling LLMs called depth up-scaling (DUS), which encompasses architectural modifications with continued pretraining. Using the solar paper as a base, I integrated Llama-3 weights into the upscaled layers, and In the future plan to continue training the model.</p>
|
29 |
<p>Aura-llama is a merge of the following models to create a base model to work from:</p>
|
30 |
<ul>
|
31 |
-
<li><a href="https://huggingface.co/
|
32 |
-
<li><a href="https://huggingface.co/
|
33 |
</ul>
|
34 |
</div>
|
35 |
<div class="update-section">
|
|
|
28 |
<p>Aura-llama is using the methodology presented by SOLAR for scaling LLMs called depth up-scaling (DUS), which encompasses architectural modifications with continued pretraining. Using the solar paper as a base, I integrated Llama-3 weights into the upscaled layers, and In the future plan to continue training the model.</p>
|
29 |
<p>Aura-llama is a merge of the following models to create a base model to work from:</p>
|
30 |
<ul>
|
31 |
+
<li><a href="https://huggingface.co/failspy/Llama-3-8B-Instruct-abliterated">failspy/Llama-3-8B-Instruct-abliterated</a></li>
|
32 |
+
<li><a href="https://huggingface.co/failspy/Llama-3-8B-Instruct-abliterated">failspy/Llama-3-8B-Instruct-abliterated</a></li>
|
33 |
</ul>
|
34 |
</div>
|
35 |
<div class="update-section">
|