Update README.md
Browse files
README.md
CHANGED
|
@@ -60,7 +60,10 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 60 |
|
| 61 |
# mega-ar-small-4096-NC-minipile-v1
|
| 62 |
|
| 63 |
-
65M parameter MEGA autoregressive model initialized from scratch and trained on
|
|
|
|
|
|
|
|
|
|
| 64 |
|
| 65 |
|
| 66 |
It achieves the following results on the evaluation set:
|
|
|
|
| 60 |
|
| 61 |
# mega-ar-small-4096-NC-minipile-v1
|
| 62 |
|
| 63 |
+
65M parameter MEGA autoregressive model initialized from scratch and trained on:
|
| 64 |
+
|
| 65 |
+
1. `pszemraj/simple_wikipedia_LM`
|
| 66 |
+
2. `JeanKaddour/minipile`
|
| 67 |
|
| 68 |
|
| 69 |
It achieves the following results on the evaluation set:
|