Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
# ELECTRA discriminator base
|
2 |
- pretrained with large Korean corpus datasets (30GB)
|
3 |
-
- 113M model parameters (followed google/electra-
|
4 |
- 35,000 vocab size
|
5 |
- trained for 1,000,000 steps
|
6 |
- built on [lassl](https://github.com/lassl/lassl) framework
|
|
|
1 |
# ELECTRA discriminator base
|
2 |
- pretrained with large Korean corpus datasets (30GB)
|
3 |
+
- 113M model parameters (followed google/electra-base-discriminator config)
|
4 |
- 35,000 vocab size
|
5 |
- trained for 1,000,000 steps
|
6 |
- built on [lassl](https://github.com/lassl/lassl) framework
|