nsadeq commited on
Commit
a909c7b
·
1 Parent(s): a351d7d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -6,7 +6,7 @@ license: apache-2.0
6
 
7
  ## Introduction
8
 
9
- InformBERT is pretrained model trained using variable masking strategy, where informative tokens are masked more frequently compared to other tokens. InformBERT outperforms random masking based pretrained models on the factual recall benchmark LAMA and extractive question answering benchmark SQuAD.
10
 
11
  More detail: https://arxiv.org/abs/2210.11771
12
 
 
6
 
7
  ## Introduction
8
 
9
+ InformBERT is pretrained using variable masking strategy, where informative tokens are masked more frequently compared to other tokens. InformBERT outperforms random masking based pretrained models on the factual recall benchmark LAMA and extractive question answering benchmark SQuAD.
10
 
11
  More detail: https://arxiv.org/abs/2210.11771
12