Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,11 @@ You can download the 24 Chinese RoBERTa miniatures either from the [UER-py Githu
|
|
| 19 |
| **L=8** |[8/128]|[8/256]|[**8/512 (BERT-Medium)**]|[8/768]|
|
| 20 |
| **L=10** |[10/128]|[10/256]|[10/512]|[10/768]|
|
| 21 |
| **L=12** |[12/128]|[12/256]|[12/512]|[**12/768 (BERT-Base)**]|
|
| 22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
## Training data
|
| 24 |
|
| 25 |
CLUECorpus2020 and CLUECorpusSmall are used as training corpus.
|
|
|
|
| 19 |
| **L=8** |[8/128]|[8/256]|[**8/512 (BERT-Medium)**]|[8/768]|
|
| 20 |
| **L=10** |[10/128]|[10/256]|[10/512]|[10/768]|
|
| 21 |
| **L=12** |[12/128]|[12/256]|[12/512]|[**12/768 (BERT-Base)**]|
|
| 22 |
+
|
| 23 |
+
## How to use
|
| 24 |
+
|
| 25 |
+
xxxxxx
|
| 26 |
+
|
| 27 |
## Training data
|
| 28 |
|
| 29 |
CLUECorpus2020 and CLUECorpusSmall are used as training corpus.
|