Update README.md
Browse files
README.md
CHANGED
@@ -142,11 +142,11 @@ python3 pretrain.py --dataset_path cluecorpussmall_seq512_dataset.pt \
|
|
142 |
--tie_weights --embedding word_pos_seg --encoder transformer --mask fully_visible --target mlm
|
143 |
```
|
144 |
|
145 |
-
Finally, we convert the pre-trained model into
|
146 |
```
|
147 |
python3 scripts/convert_bert_from_uer_to_huggingface.py --input_model_path pytorch_model.bin
|
148 |
--output_model_path huggingface_model.bin
|
149 |
-
--layers_num
|
150 |
```
|
151 |
|
152 |
### BibTeX entry and citation info
|
|
|
142 |
--tie_weights --embedding word_pos_seg --encoder transformer --mask fully_visible --target mlm
|
143 |
```
|
144 |
|
145 |
+
Finally, we convert the pre-trained model into Huggingface's format:
|
146 |
```
|
147 |
python3 scripts/convert_bert_from_uer_to_huggingface.py --input_model_path pytorch_model.bin
|
148 |
--output_model_path huggingface_model.bin
|
149 |
+
--layers_num 8 --target mlm
|
150 |
```
|
151 |
|
152 |
### BibTeX entry and citation info
|