Commit
·
baed986
1
Parent(s):
d249c1c
Update README.md
Browse files
README.md
CHANGED
|
@@ -34,6 +34,11 @@ python3 ./trdg/run.py -i ocr_dataset_poc.txt -w 5 -t {num_cores} -f 64 -l ko -c
|
|
| 34 |
```
|
| 35 |
|
| 36 |
## Training
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
We used heuristic parameters without separate hyperparameter tuning.
|
| 38 |
- learning_rate = 4e-5
|
| 39 |
- epochs = 25
|
|
|
|
| 34 |
```
|
| 35 |
|
| 36 |
## Training
|
| 37 |
+
|
| 38 |
+
### Base model
|
| 39 |
+
The encoder model used `facebook/deit-base-distilled-patch16-384` and the decoder model used `klue/roberta-base`. It is easier than training by starting weights from `microsoft/trocr-base-stage1`.
|
| 40 |
+
|
| 41 |
+
### Parameters
|
| 42 |
We used heuristic parameters without separate hyperparameter tuning.
|
| 43 |
- learning_rate = 4e-5
|
| 44 |
- epochs = 25
|