Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ library_name: transformers
|
|
16 |
---
|
17 |
<img src="llama-blackjack.jpeg" width="640" height="640">
|
18 |
|
19 |
-
The provided model is a multi-
|
20 |
|
21 |
q3_k_s GGUF :https://huggingface.co/sydonayrex/Blackjack-Llama3-21B-Q3_K_S-GGUF
|
22 |
|
|
|
16 |
---
|
17 |
<img src="llama-blackjack.jpeg" width="640" height="640">
|
18 |
|
19 |
+
The provided model is a multi-layered folded model, using multiple layers from the base Llama3 8B Instruct base, to increase its size to 21B parameters using mergekit. Rather than just using passthrough, task arithmetic was used. Further fine tuning was performed to ensure the model's weights and inference should be rebaselined.
|
20 |
|
21 |
q3_k_s GGUF :https://huggingface.co/sydonayrex/Blackjack-Llama3-21B-Q3_K_S-GGUF
|
22 |
|