AleRothermel commited on
Commit
c6693f6
·
verified ·
1 Parent(s): 1c00eb8

End of training

Browse files
README.md ADDED
@@ -0,0 +1,184 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: bert-base-cased
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - accuracy
8
+ model-index:
9
+ - name: mi-1.2-model
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # mi-1.2-model
17
+
18
+ This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on an unknown dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 1.7264
21
+ - Accuracy: 0.58
22
+
23
+ ## Model description
24
+
25
+ More information needed
26
+
27
+ ## Intended uses & limitations
28
+
29
+ More information needed
30
+
31
+ ## Training and evaluation data
32
+
33
+ More information needed
34
+
35
+ ## Training procedure
36
+
37
+ ### Training hyperparameters
38
+
39
+ The following hyperparameters were used during training:
40
+ - learning_rate: 5e-05
41
+ - train_batch_size: 8
42
+ - eval_batch_size: 8
43
+ - seed: 42
44
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: linear
46
+ - num_epochs: 5
47
+
48
+ ### Training results
49
+
50
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
+ |:-------------:|:------:|:----:|:---------------:|:--------:|
52
+ | 1.6501 | 0.04 | 10 | 1.6095 | 0.235 |
53
+ | 1.655 | 0.08 | 20 | 1.5876 | 0.23 |
54
+ | 1.6465 | 0.12 | 30 | 1.5874 | 0.305 |
55
+ | 1.6577 | 0.16 | 40 | 1.6006 | 0.2325 |
56
+ | 1.5666 | 0.2 | 50 | 1.5611 | 0.245 |
57
+ | 1.5667 | 0.24 | 60 | 1.4245 | 0.44 |
58
+ | 1.4837 | 0.28 | 70 | 1.2916 | 0.4175 |
59
+ | 1.2603 | 0.32 | 80 | 1.3869 | 0.3925 |
60
+ | 1.2865 | 0.36 | 90 | 1.4055 | 0.3475 |
61
+ | 1.4037 | 0.4 | 100 | 1.3934 | 0.32 |
62
+ | 1.3201 | 0.44 | 110 | 1.4511 | 0.4125 |
63
+ | 1.3977 | 0.48 | 120 | 1.2251 | 0.44 |
64
+ | 1.1444 | 0.52 | 130 | 1.1517 | 0.5175 |
65
+ | 1.1627 | 0.56 | 140 | 1.1211 | 0.5225 |
66
+ | 1.21 | 0.6 | 150 | 1.1336 | 0.53 |
67
+ | 1.2211 | 0.64 | 160 | 1.4186 | 0.4 |
68
+ | 1.2985 | 0.68 | 170 | 1.1251 | 0.4725 |
69
+ | 1.1856 | 0.72 | 180 | 1.1138 | 0.5075 |
70
+ | 1.1027 | 0.76 | 190 | 1.0810 | 0.5075 |
71
+ | 1.0998 | 0.8 | 200 | 1.1034 | 0.5225 |
72
+ | 1.2546 | 0.84 | 210 | 1.1205 | 0.4925 |
73
+ | 1.0265 | 0.88 | 220 | 1.1996 | 0.4925 |
74
+ | 1.0898 | 0.92 | 230 | 1.1002 | 0.515 |
75
+ | 1.19 | 0.96 | 240 | 1.0805 | 0.4925 |
76
+ | 1.1456 | 1.0 | 250 | 1.0509 | 0.525 |
77
+ | 0.9265 | 1.04 | 260 | 1.1092 | 0.51 |
78
+ | 0.8554 | 1.08 | 270 | 1.0098 | 0.5325 |
79
+ | 0.8695 | 1.12 | 280 | 1.0991 | 0.4975 |
80
+ | 0.8505 | 1.16 | 290 | 1.0827 | 0.5075 |
81
+ | 0.8892 | 1.2 | 300 | 1.1195 | 0.52 |
82
+ | 0.8982 | 1.24 | 310 | 1.0691 | 0.51 |
83
+ | 0.9301 | 1.28 | 320 | 1.0236 | 0.545 |
84
+ | 1.052 | 1.32 | 330 | 1.0296 | 0.535 |
85
+ | 0.8072 | 1.3600 | 340 | 1.0227 | 0.55 |
86
+ | 0.8822 | 1.4 | 350 | 1.0494 | 0.53 |
87
+ | 1.1561 | 1.44 | 360 | 1.2036 | 0.4925 |
88
+ | 0.9526 | 1.48 | 370 | 1.0443 | 0.56 |
89
+ | 0.9916 | 1.52 | 380 | 1.0378 | 0.555 |
90
+ | 1.0388 | 1.56 | 390 | 1.0920 | 0.5375 |
91
+ | 0.9326 | 1.6 | 400 | 1.0510 | 0.5375 |
92
+ | 0.8453 | 1.6400 | 410 | 1.1247 | 0.5025 |
93
+ | 1.03 | 1.6800 | 420 | 1.0281 | 0.565 |
94
+ | 0.971 | 1.72 | 430 | 1.0322 | 0.54 |
95
+ | 0.941 | 1.76 | 440 | 0.9858 | 0.565 |
96
+ | 0.8615 | 1.8 | 450 | 0.9793 | 0.555 |
97
+ | 0.8815 | 1.8400 | 460 | 0.9778 | 0.56 |
98
+ | 0.7658 | 1.88 | 470 | 0.9760 | 0.56 |
99
+ | 1.0073 | 1.92 | 480 | 1.0747 | 0.5175 |
100
+ | 0.8929 | 1.96 | 490 | 0.9910 | 0.565 |
101
+ | 0.9089 | 2.0 | 500 | 1.0512 | 0.535 |
102
+ | 0.5102 | 2.04 | 510 | 1.0545 | 0.555 |
103
+ | 0.6748 | 2.08 | 520 | 1.1621 | 0.5175 |
104
+ | 0.5222 | 2.12 | 530 | 1.1038 | 0.5575 |
105
+ | 0.7978 | 2.16 | 540 | 1.1728 | 0.53 |
106
+ | 0.6749 | 2.2 | 550 | 1.1029 | 0.5475 |
107
+ | 0.6621 | 2.24 | 560 | 1.0977 | 0.5425 |
108
+ | 0.6808 | 2.2800 | 570 | 1.1776 | 0.545 |
109
+ | 0.5728 | 2.32 | 580 | 1.1747 | 0.5325 |
110
+ | 0.75 | 2.36 | 590 | 1.1707 | 0.5275 |
111
+ | 0.6622 | 2.4 | 600 | 1.1082 | 0.555 |
112
+ | 0.6008 | 2.44 | 610 | 1.0922 | 0.57 |
113
+ | 0.6491 | 2.48 | 620 | 1.1375 | 0.545 |
114
+ | 0.5876 | 2.52 | 630 | 1.0614 | 0.5675 |
115
+ | 0.5326 | 2.56 | 640 | 1.0460 | 0.58 |
116
+ | 0.4901 | 2.6 | 650 | 1.0864 | 0.58 |
117
+ | 0.6151 | 2.64 | 660 | 1.1919 | 0.58 |
118
+ | 0.6478 | 2.68 | 670 | 1.1301 | 0.5575 |
119
+ | 0.4841 | 2.7200 | 680 | 1.1451 | 0.58 |
120
+ | 0.6365 | 2.76 | 690 | 1.0701 | 0.575 |
121
+ | 0.5284 | 2.8 | 700 | 1.1674 | 0.5325 |
122
+ | 0.6506 | 2.84 | 710 | 1.1016 | 0.55 |
123
+ | 0.6446 | 2.88 | 720 | 1.1340 | 0.57 |
124
+ | 0.5193 | 2.92 | 730 | 1.1692 | 0.525 |
125
+ | 0.6129 | 2.96 | 740 | 1.1717 | 0.5325 |
126
+ | 0.6013 | 3.0 | 750 | 1.1374 | 0.55 |
127
+ | 0.3392 | 3.04 | 760 | 1.2702 | 0.515 |
128
+ | 0.3188 | 3.08 | 770 | 1.2584 | 0.515 |
129
+ | 0.3272 | 3.12 | 780 | 1.3520 | 0.5225 |
130
+ | 0.341 | 3.16 | 790 | 1.2752 | 0.5575 |
131
+ | 0.3826 | 3.2 | 800 | 1.3126 | 0.55 |
132
+ | 0.3062 | 3.24 | 810 | 1.4909 | 0.52 |
133
+ | 0.2657 | 3.2800 | 820 | 1.3804 | 0.5575 |
134
+ | 0.4609 | 3.32 | 830 | 1.3712 | 0.5625 |
135
+ | 0.3388 | 3.36 | 840 | 1.4701 | 0.5275 |
136
+ | 0.3007 | 3.4 | 850 | 1.3373 | 0.57 |
137
+ | 0.2732 | 3.44 | 860 | 1.3699 | 0.575 |
138
+ | 0.4551 | 3.48 | 870 | 1.3874 | 0.555 |
139
+ | 0.3048 | 3.52 | 880 | 1.4913 | 0.5625 |
140
+ | 0.4104 | 3.56 | 890 | 1.4586 | 0.565 |
141
+ | 0.2633 | 3.6 | 900 | 1.4353 | 0.565 |
142
+ | 0.4435 | 3.64 | 910 | 1.5246 | 0.555 |
143
+ | 0.282 | 3.68 | 920 | 1.6866 | 0.5275 |
144
+ | 0.5918 | 3.7200 | 930 | 1.5193 | 0.5525 |
145
+ | 0.315 | 3.76 | 940 | 1.4276 | 0.565 |
146
+ | 0.1276 | 3.8 | 950 | 1.4411 | 0.5625 |
147
+ | 0.3389 | 3.84 | 960 | 1.5420 | 0.5625 |
148
+ | 0.3248 | 3.88 | 970 | 1.4492 | 0.575 |
149
+ | 0.3051 | 3.92 | 980 | 1.4321 | 0.5925 |
150
+ | 0.3363 | 3.96 | 990 | 1.4374 | 0.5825 |
151
+ | 0.4602 | 4.0 | 1000 | 1.4581 | 0.57 |
152
+ | 0.1582 | 4.04 | 1010 | 1.4434 | 0.5675 |
153
+ | 0.2344 | 4.08 | 1020 | 1.4551 | 0.5975 |
154
+ | 0.2646 | 4.12 | 1030 | 1.4999 | 0.59 |
155
+ | 0.1948 | 4.16 | 1040 | 1.5550 | 0.5625 |
156
+ | 0.3058 | 4.2 | 1050 | 1.5955 | 0.5775 |
157
+ | 0.1569 | 4.24 | 1060 | 1.5721 | 0.575 |
158
+ | 0.1777 | 4.28 | 1070 | 1.6241 | 0.56 |
159
+ | 0.1256 | 4.32 | 1080 | 1.5711 | 0.575 |
160
+ | 0.2467 | 4.36 | 1090 | 1.5735 | 0.59 |
161
+ | 0.1964 | 4.4 | 1100 | 1.5924 | 0.585 |
162
+ | 0.0578 | 4.44 | 1110 | 1.6353 | 0.585 |
163
+ | 0.1358 | 4.48 | 1120 | 1.6710 | 0.5775 |
164
+ | 0.174 | 4.52 | 1130 | 1.6733 | 0.5725 |
165
+ | 0.2022 | 4.5600 | 1140 | 1.6658 | 0.585 |
166
+ | 0.028 | 4.6 | 1150 | 1.6708 | 0.585 |
167
+ | 0.1222 | 4.64 | 1160 | 1.6989 | 0.5875 |
168
+ | 0.2295 | 4.68 | 1170 | 1.7131 | 0.5825 |
169
+ | 0.374 | 4.72 | 1180 | 1.7197 | 0.5725 |
170
+ | 0.1342 | 4.76 | 1190 | 1.7237 | 0.575 |
171
+ | 0.079 | 4.8 | 1200 | 1.7267 | 0.58 |
172
+ | 0.154 | 4.84 | 1210 | 1.7204 | 0.585 |
173
+ | 0.0403 | 4.88 | 1220 | 1.7183 | 0.58 |
174
+ | 0.1964 | 4.92 | 1230 | 1.7253 | 0.5775 |
175
+ | 0.1297 | 4.96 | 1240 | 1.7252 | 0.5775 |
176
+ | 0.0834 | 5.0 | 1250 | 1.7264 | 0.58 |
177
+
178
+
179
+ ### Framework versions
180
+
181
+ - Transformers 4.40.2
182
+ - Pytorch 2.2.1+cu121
183
+ - Datasets 2.19.1
184
+ - Tokenizers 0.19.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:162a01646091282448ae163c07fa8f1c94272d33b1b762ba374f1328882eaa51
3
  size 433279996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af09d594d3df8f6fa3c8c2bb5d4888a7d9784793c5c37449c635ef6d6015352b
3
  size 433279996
runs/May20_02-37-11_07b71be6d35e/events.out.tfevents.1716172642.07b71be6d35e.6471.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:381bd2e9b5039540e0ba60e55c42f3f096983e6892292b0910a7cdeaa94a8c52
3
- size 58153
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02516ed93a38c993ecba093b7ca79c6077ab8bde64c14802b69df913b5c45e13
3
+ size 71857