Aidan Mannion
commited on
Commit
·
5011bfb
1
Parent(s):
b2b97cc
Update README.md
Browse files
README.md
CHANGED
@@ -21,10 +21,20 @@ The idea behind this framework was to try to improve the robustness of specialis
|
|
21 |
- **Developed by:** Aidan Mannion
|
22 |
- **Funded by :** GENCI-IDRIS grant AD011013535R1
|
23 |
- **Model type:** DistilBERT
|
24 |
-
- **Language(s) (NLP):**
|
25 |
|
26 |
For further details on the model architecture, training objectives, hardware \& software used, as well as the preliminary downstream evaluation experiments carried out, refer to the [ArXiv paper](https://arxiv.org/abs/2307.11170).
|
27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
28 |
|
29 |
### Direct/Downstream Use
|
30 |
|
|
|
21 |
- **Developed by:** Aidan Mannion
|
22 |
- **Funded by :** GENCI-IDRIS grant AD011013535R1
|
23 |
- **Model type:** DistilBERT
|
24 |
+
- **Language(s) (NLP):** Spanish
|
25 |
|
26 |
For further details on the model architecture, training objectives, hardware \& software used, as well as the preliminary downstream evaluation experiments carried out, refer to the [ArXiv paper](https://arxiv.org/abs/2307.11170).
|
27 |
|
28 |
+
### UMLS-KGI Models
|
29 |
+
| **Model** | **Model Repo** | **Dataset Size** | **Base Architecture** | **Base Model** | **Total KGI training steps** |
|
30 |
+
|:--------------------------:|----------------------------------------------------------------------------|:----------------:|:---------------------:|:---------------------------------------------------------------------------------------------:|:----------------------------:|
|
31 |
+
| UMLS-KGI-BERT-multilingual | [url-multi](https://huggingface.co/ap-mannion/umls-kgi-bert-multilingual | 940MB | DistilBERT | n/a | 163,904 |
|
32 |
+
| UMLS-KGI-BERT-FR | [url-fr](https://huggingface.co/ap-mannion/umls-kgi-bert-fr) | 604MB | DistilBERT | n/a | 126,720 |
|
33 |
+
| UMLS-KGI-BERT-EN | [url-en](https://huggingface.co/ap-mannion/umls-kgi-bert-en) | 174MB | DistilBERT | n/a | 19,008 |
|
34 |
+
| UMLS-KGI-BERT-ES | [url-es](https://huggingface.co/ap-mannion/umls-kgi-bert-es) | 162MB | DistilBERT | n/a | 18,176 |
|
35 |
+
| DrBERT-UMLS-KGI | [url-drbert](https://huggingface.co/ap-mannion/drbert-umls-kgi) | 604MB | CamemBERT/RoBERTa | [DrBERT-4GB](https://huggingface.co/Dr-BERT/DrBERT-4GB) | 126,720 |
|
36 |
+
| PubMedBERT-UMLS-KGI | [url-pubmedbert](https://huggingface.co/ap-mannion/pubmedbert-umls-kgi) | 174MB | BERT | microsoft/BiomedNLP-PubMedBERT-base-uncased-abstract | 19,008 |
|
37 |
+
| BioRoBERTa-ES-UMLS-KGI | [url-bioroberta](https://huggingface.co/ap-mannion/bioroberta-es-umls-kgi) | 162MB | RoBERTa | [RoBERTa-base-biomedical-es](https://huggingface.co/PlanTL-GOB-ES/roberta-base-biomedical-es) | 18,176 |
|
38 |
|
39 |
### Direct/Downstream Use
|
40 |
|