Update README.md

README.md

@@ -6,12 +6,12 @@ tags: []
 # 5CD-AI/visocial-T5-base
 ## Overview
 <!-- Provide a quick summary of what the model is/does. -->
-We continually pretrain `google/mt5-base` on a merged 20GB dataset, the training dataset includes:
+We continually pretrain `google/mt5-base`[1] on a merged 20GB dataset, the training dataset includes:
 - Internal data (100M comments and 15M posts on Facebook)
-- UIT data, which is used to pretrain `uitnlp/visobert`
+- UIT data [2], which is used to pretrain `uitnlp/visobert`[2]
 - MC4 ecommerce
 - 10.7M comments on VOZ Forum from `tarudesu/VOZ-HSD`
-- 3.6M reviews from Amazon translated into Vietnamese from `5CD-AI/Vietnamese-amazon_polarity-gg-translated`
+- 3.6M reviews from Amazon[3] translated into Vietnamese from `5CD-AI/Vietnamese-amazon_polarity-gg-translated`
 
 Here are the results on 3 downstream tasks on Vietnamese social media texts, including Hate Speech Detection(UIT-HSD), Toxic Speech Detection(ViCTSD), Hate Spans Detection(ViHOS):
 <table>
@@ -142,4 +142,9 @@ We fine-tune `5CD-AI/visocial-T5-base` on 3 downstream tasks with `transformers`
 - model_max_length: 256
 - metric_for_best_model: eval_loss
 - evaluation_strategy: steps
-- eval_steps=0.1
+- eval_steps=0.1
+
+## References
+[1][mT5: A massively multilingual pre-trained text-to-text transformer](https://arxiv.org/abs/2010.11934)
+[2][ViSoBERT: A Pre-Trained Language Model for Vietnamese Social Media Text Processing](https://aclanthology.org/2023.emnlp-main.315/)
+[3][The Amazon Polarity dataset](https://paperswithcode.com/dataset/amazon-polarity-1)