ghaddara commited on
Commit
6f744be
·
1 Parent(s): 0d032bb

add overview

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -1,3 +1,27 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ # Overview
6
+
7
+ <p align="center">
8
+ <img src="https://avatars.githubusercontent.com/u/12619994?s=200&v=4" width="150">
9
+ </p>
10
+
11
+ <!-- -------------------------------------------------------------------------------- -->
12
+
13
+ AT5S is an Arabic T5-small model. It's is **only compatible** with the code in [this github repo](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/JABER-PyTorch) (not supported by the [Transformers](https://github.com/huggingface/transformers) library)
14
+
15
+ ## Citation
16
+
17
+ Please cite the following [paper](https://arxiv.org/pdf/2205.10687.pdf) when using our code and model:
18
+
19
+ ``` bibtex
20
+ @article{ghaddar2022revisiting,
21
+ title={Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding},
22
+ author={Ghaddar, Abbas and Wu, Yimeng and Bagga, Sunyam and Rashid, Ahmad and Bibi, Khalil and Rezagholizadeh, Mehdi and Xing, Chao and Wang, Yasheng and Xinyu, Duan and Wang, Zhefeng and others},
23
+ journal={arXiv preprint arXiv:2205.10687},
24
+ year={2022}
25
+ }
26
+ ```
27
+