Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,14 @@ tags:
|
|
| 12 |
# about
|
| 13 |
|
| 14 |
A simple curiosity, to see if the Trojka v2 benchs results are reproduced with another lead model.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
---
|
| 17 |
# merge
|
|
|
|
| 12 |
# about
|
| 13 |
|
| 14 |
A simple curiosity, to see if the Trojka v2 benchs results are reproduced with another lead model.
|
| 15 |
+
And the experience worked, at least in benchs. I have to test all of this in chat now.
|
| 16 |
+
|
| 17 |
+
---
|
| 18 |
+
# benchs
|
| 19 |
+
|
| 20 |
+
- PPL 512 Wikitext Eng : 3.09 (very good)
|
| 21 |
+
- ARC-C : 65.55 (I never merged anything >= 64 before, and that's already very high, most of L3 merges are between 53 and 59. 64 +3% is beyond the margin of error, this might be a record.)
|
| 22 |
+
- ARC-E : 82.80 (This is the usual plateau of my best merges)
|
| 23 |
|
| 24 |
---
|
| 25 |
# merge
|