Update README.md
Browse files
README.md
CHANGED
|
@@ -40,16 +40,15 @@ python3 run_cmrc.py --pretrained_model_path models/cluecorpussmall_roberta_base_
|
|
| 40 |
--train_path extractive_qa.json \
|
| 41 |
--dev_path datasets/cmrc2018/dev.json \
|
| 42 |
--output_model_path models/extractive_qa_model.bin \
|
| 43 |
-
--learning_rate 3e-5 --
|
| 44 |
-
--embedding word_pos_seg --encoder transformer --mask fully_visible
|
| 45 |
```
|
| 46 |
|
| 47 |
Finally, we convert the fine-tuned model into Huggingface's format:
|
| 48 |
|
| 49 |
```
|
| 50 |
python3 scripts/convert_bert_extractive_qa_from_uer_to_huggingface.py --input_model_path extractive_qa_model.bin \
|
| 51 |
-
|
| 52 |
-
|
| 53 |
```
|
| 54 |
|
| 55 |
### BibTeX entry and citation info
|
|
|
|
| 40 |
--train_path extractive_qa.json \
|
| 41 |
--dev_path datasets/cmrc2018/dev.json \
|
| 42 |
--output_model_path models/extractive_qa_model.bin \
|
| 43 |
+
--learning_rate 3e-5 --epochs_num 3 --batch_size 32 --seq_length 512
|
|
|
|
| 44 |
```
|
| 45 |
|
| 46 |
Finally, we convert the fine-tuned model into Huggingface's format:
|
| 47 |
|
| 48 |
```
|
| 49 |
python3 scripts/convert_bert_extractive_qa_from_uer_to_huggingface.py --input_model_path extractive_qa_model.bin \
|
| 50 |
+
--output_model_path pytorch_model.bin \
|
| 51 |
+
--layers_num 12
|
| 52 |
```
|
| 53 |
|
| 54 |
### BibTeX entry and citation info
|