Hugging Face's logo

SkyWater21
/
lvbert-lv-go-emotions

Text Classification
Transformers
Safetensors
Latvian
bert
Inference Endpoints
Model card Files Community
lvbert-lv-go-emotions
File size: 3,384 Bytes 
6389cdb
 
 
 
 
 
02582b0
 
8143448
02582b0
8143448
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3db324f
 
 
 
 
 
 
 
 
 
5c3af3a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8143448
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
 
---
license: mit
datasets:
- SkyWater21/lv_go_emotions
language:
- lv
---

Fine-tuned [LVBERT](https://huggingface.co/AiLab-IMCS-UL/lvbert) for multi-label emotion classification task.

Model was trained on [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions) dataset. This dataset is Latvian translation of [GoEmotions](https://huggingface.co/datasets/go_emotions) dataset. Google Translate was used to generate the machine translation.

Labels:
```yaml
0: admiration
1: amusement
2: anger
3: annoyance
4: approval
5: caring
6: confusion
7: curiosity
8: desire
9: disappointment
10: disapproval
11: disgust
12: embarrassment
13: excitement
14: fear
15: gratitude
16: grief
17: joy
18: love
19: nervousness
20: optimism
21: pride
22: realization
23: relief
24: remorse
25: sadness
26: surprise
27: neutral
```

Seed used for random number generator is 42:
```python
def set_seed(seed=42):
    random.seed(seed)
    np.random.seed(seed)
    torch.manual_seed(seed)
    if torch.cuda.is_available():
        torch.cuda.manual_seed_all(seed)
```

Training parameters:
```yaml
max_length: null
batch_size: 32
shuffle: True
num_workers: 2
pin_memory: False
drop_last: False

optimizer: adam
lr: 0.00001
weight_decay: 0

problem_type: multi_label_classification

num_epochs: 5
```

Evaluation results on test split of [lv_go_emotions](https://huggingface.co/datasets/SkyWater21/lv_go_emotions)
|              |Precision|Recall|F1-Score|AUC-ROC|Support|
|--------------|---------|------|--------|-------|-------|
|admiration    |     0.64|  0.64|    0.64|   0.92|   504|
|amusement     |     0.76|  0.85|    0.80|   0.96|   264|
|anger         |     0.51|  0.21|    0.29|   0.86|   198|
|annoyance     |     0.49|  0.15|    0.23|   0.78|   320|
|approval      |     0.35|  0.33|    0.34|   0.80|   351|
|caring        |     0.43|  0.39|    0.41|   0.89|   135|
|confusion     |     0.53|  0.33|    0.41|   0.94|   153|
|curiosity     |     0.49|  0.42|    0.45|   0.94|   284|
|desire        |     0.63|  0.37|    0.47|   0.92|    83|
|disappointment|     0.45|  0.11|    0.18|   0.82|   151|
|disapproval   |     0.45|  0.25|    0.32|   0.84|   267|
|disgust       |     0.63|  0.29|    0.40|   0.92|   123|
|embarrassment |     0.50|  0.14|    0.21|   0.85|    37|
|excitement    |     0.55|  0.16|    0.24|   0.89|   103|
|fear          |     0.65|  0.58|    0.61|   0.95|    78|
|gratitude     |     0.88|  0.91|    0.90|   0.99|   352|
|grief         |     0.00|  0.00|    0.00|   0.78|     6|
|joy           |     0.61|  0.39|    0.47|   0.93|   161|
|love          |     0.80|  0.69|    0.74|   0.97|   238|
|nervousness   |     0.00|  0.00|    0.00|   0.95|    23|
|optimism      |     0.57|  0.47|    0.52|   0.90|   186|
|pride         |     0.00|  0.00|    0.00|   0.73|    16|
|realization   |     0.29|  0.08|    0.13|   0.76|   145|
|relief        |     0.00|  0.00|    0.00|   0.85|    11|
|remorse       |     0.54|  0.68|    0.60|   0.98|    56|
|sadness       |     0.60|  0.50|    0.54|   0.93|   156|
|surprise      |     0.65|  0.41|    0.50|   0.92|   141|
|neutral       |     0.67|  0.50|    0.57|   0.81|  1787|
|micro avg     |     0.62|  0.46|    0.53|   0.93|  6329|
|macro avg     |     0.49|  0.35|    0.39|   0.88|  6329|
|weighted avg  |     0.60|  0.46|    0.51|   0.87|  6329|
|samples avg   |     0.52|  0.48|    0.49|    nan|  6329|