Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,74 @@ language:
|
|
| 6 |
- lv
|
| 7 |
---
|
| 8 |
|
| 9 |
-
Fine-tuned [LVBERT](https://huggingface.co/AiLab-IMCS-UL/lvbert) for emotion classification.
|
| 10 |
|
| 11 |
-
Model was trained on [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions) dataset. This dataset is Latvian translation of [GoEmotions](https://huggingface.co/datasets/go_emotions) dataset. Google Translate was used to generate the machine translation.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
- lv
|
| 7 |
---
|
| 8 |
|
| 9 |
+
Fine-tuned [LVBERT](https://huggingface.co/AiLab-IMCS-UL/lvbert) for multi-label emotion classification task.
|
| 10 |
|
| 11 |
+
Model was trained on [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions) dataset. This dataset is Latvian translation of [GoEmotions](https://huggingface.co/datasets/go_emotions) dataset. Google Translate was used to generate the machine translation.
|
| 12 |
+
|
| 13 |
+
Labels:
|
| 14 |
+
```yaml
|
| 15 |
+
0: admiration
|
| 16 |
+
1: amusement
|
| 17 |
+
2: anger
|
| 18 |
+
3: annoyance
|
| 19 |
+
4: approval
|
| 20 |
+
5: caring
|
| 21 |
+
6: confusion
|
| 22 |
+
7: curiosity
|
| 23 |
+
8: desire
|
| 24 |
+
9: disappointment
|
| 25 |
+
10: disapproval
|
| 26 |
+
11: disgust
|
| 27 |
+
12: embarrassment
|
| 28 |
+
13: excitement
|
| 29 |
+
14: fear
|
| 30 |
+
15: gratitude
|
| 31 |
+
16: grief
|
| 32 |
+
17: joy
|
| 33 |
+
18: love
|
| 34 |
+
19: nervousness
|
| 35 |
+
20: optimism
|
| 36 |
+
21: pride
|
| 37 |
+
22: realization
|
| 38 |
+
23: relief
|
| 39 |
+
24: remorse
|
| 40 |
+
25: sadness
|
| 41 |
+
26: surprise
|
| 42 |
+
27: neutral
|
| 43 |
+
```
|
| 44 |
+
|
| 45 |
+
Evaluation results on test split of [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions)
|
| 46 |
+
| |Precision|Recall|F1-Score|AUC-ROC|Support|
|
| 47 |
+
|--------------|---------|------|--------|-------|-------|
|
| 48 |
+
|admiration | 0.64| 0.64| 0.64| 0.92| 504|
|
| 49 |
+
|amusement | 0.76| 0.85| 0.80| 0.96| 264|
|
| 50 |
+
|anger | 0.51| 0.21| 0.29| 0.86| 198|
|
| 51 |
+
|annoyance | 0.49| 0.15| 0.23| 0.78| 320|
|
| 52 |
+
|approval | 0.35| 0.33| 0.34| 0.80| 351|
|
| 53 |
+
|caring | 0.43| 0.39| 0.41| 0.89| 135|
|
| 54 |
+
|confusion | 0.53| 0.33| 0.41| 0.94| 153|
|
| 55 |
+
|curiosity | 0.49| 0.42| 0.45| 0.94| 284|
|
| 56 |
+
|desire | 0.63| 0.37| 0.47| 0.92| 83|
|
| 57 |
+
|disappointment| 0.45| 0.11| 0.18| 0.82| 151|
|
| 58 |
+
|disapproval | 0.45| 0.25| 0.32| 0.84| 267|
|
| 59 |
+
|disgust | 0.63| 0.29| 0.40| 0.92| 123|
|
| 60 |
+
|embarrassment | 0.50| 0.14| 0.21| 0.85| 37|
|
| 61 |
+
|excitement | 0.55| 0.16| 0.24| 0.89| 103|
|
| 62 |
+
|fear | 0.65| 0.58| 0.61| 0.95| 78|
|
| 63 |
+
|gratitude | 0.88| 0.91| 0.90| 0.99| 352|
|
| 64 |
+
|grief | 0.00| 0.00| 0.00| 0.78| 6|
|
| 65 |
+
|joy | 0.61| 0.39| 0.47| 0.93| 161|
|
| 66 |
+
|love | 0.80| 0.69| 0.74| 0.97| 238|
|
| 67 |
+
|nervousness | 0.00| 0.00| 0.00| 0.95| 23|
|
| 68 |
+
|optimism | 0.57| 0.47| 0.52| 0.90| 186|
|
| 69 |
+
|pride | 0.00| 0.00| 0.00| 0.73| 16|
|
| 70 |
+
|realization | 0.29| 0.08| 0.13| 0.76| 145|
|
| 71 |
+
|relief | 0.00| 0.00| 0.00| 0.85| 11|
|
| 72 |
+
|remorse | 0.54| 0.68| 0.60| 0.98| 56|
|
| 73 |
+
|sadness | 0.60| 0.50| 0.54| 0.93| 156|
|
| 74 |
+
|surprise | 0.65| 0.41| 0.50| 0.92| 141|
|
| 75 |
+
|neutral | 0.67| 0.50| 0.57| 0.81| 1787|
|
| 76 |
+
|micro avg | 0.62| 0.46| 0.53| 0.93| 6329|
|
| 77 |
+
|macro avg | 0.49| 0.35| 0.39| 0.88| 6329|
|
| 78 |
+
|weighted avg | 0.60| 0.46| 0.51| 0.87| 6329|
|
| 79 |
+
|samples avg | 0.52| 0.48| 0.49| nan| 6329|
|