End of training
Browse files- README.md +21 -56
- model.safetensors +1 -1
- training_args.bin +1 -1
README.md
CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
18 |
|
19 |
This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
-
- Loss: 0.
|
22 |
-
- Accuracy: 0.
|
23 |
|
24 |
## Model description
|
25 |
|
@@ -38,68 +38,33 @@ More information needed
|
|
38 |
### Training hyperparameters
|
39 |
|
40 |
The following hyperparameters were used during training:
|
41 |
-
- learning_rate:
|
42 |
-
- train_batch_size:
|
43 |
-
- eval_batch_size:
|
44 |
- seed: 42
|
45 |
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
46 |
- lr_scheduler_type: linear
|
47 |
-
- num_epochs:
|
48 |
|
49 |
### Training results
|
50 |
|
51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
52 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
53 |
-
|
|
54 |
-
|
|
55 |
-
|
|
56 |
-
| 0.
|
57 |
-
| 0.
|
58 |
-
| 0.
|
59 |
-
| 0.
|
60 |
-
| 0.
|
61 |
-
| 0.
|
62 |
-
| 0.
|
63 |
-
| 0.
|
64 |
-
| 0.
|
65 |
-
| 0.
|
66 |
-
| 0.
|
67 |
-
| 0.
|
68 |
-
| 0.1009 | 16.0 | 2912 | 0.6678 | 0.8231 |
|
69 |
-
| 0.1044 | 17.0 | 3094 | 0.6740 | 0.8224 |
|
70 |
-
| 0.0772 | 18.0 | 3276 | 0.6965 | 0.8197 |
|
71 |
-
| 0.0887 | 19.0 | 3458 | 0.7031 | 0.8266 |
|
72 |
-
| 0.0734 | 20.0 | 3640 | 0.7171 | 0.8252 |
|
73 |
-
| 0.0684 | 21.0 | 3822 | 0.7423 | 0.8259 |
|
74 |
-
| 0.0645 | 22.0 | 4004 | 0.7384 | 0.8252 |
|
75 |
-
| 0.0582 | 23.0 | 4186 | 0.7866 | 0.8197 |
|
76 |
-
| 0.049 | 24.0 | 4368 | 0.7721 | 0.8231 |
|
77 |
-
| 0.0382 | 25.0 | 4550 | 0.7791 | 0.8279 |
|
78 |
-
| 0.0407 | 26.0 | 4732 | 0.7815 | 0.8300 |
|
79 |
-
| 0.0431 | 27.0 | 4914 | 0.8023 | 0.8231 |
|
80 |
-
| 0.0424 | 28.0 | 5096 | 0.8114 | 0.8266 |
|
81 |
-
| 0.0477 | 29.0 | 5278 | 0.8185 | 0.8252 |
|
82 |
-
| 0.0337 | 30.0 | 5460 | 0.8229 | 0.8259 |
|
83 |
-
| 0.037 | 31.0 | 5642 | 0.8141 | 0.8286 |
|
84 |
-
| 0.0304 | 32.0 | 5824 | 0.8272 | 0.8259 |
|
85 |
-
| 0.0299 | 33.0 | 6006 | 0.8365 | 0.8273 |
|
86 |
-
| 0.0175 | 34.0 | 6188 | 0.8417 | 0.8307 |
|
87 |
-
| 0.0364 | 35.0 | 6370 | 0.8430 | 0.8286 |
|
88 |
-
| 0.0247 | 36.0 | 6552 | 0.8539 | 0.8259 |
|
89 |
-
| 0.026 | 37.0 | 6734 | 0.8562 | 0.8293 |
|
90 |
-
| 0.024 | 38.0 | 6916 | 0.8610 | 0.8293 |
|
91 |
-
| 0.0176 | 39.0 | 7098 | 0.8495 | 0.8293 |
|
92 |
-
| 0.0159 | 40.0 | 7280 | 0.8643 | 0.8266 |
|
93 |
-
| 0.0218 | 41.0 | 7462 | 0.8681 | 0.8293 |
|
94 |
-
| 0.0197 | 42.0 | 7644 | 0.8669 | 0.8279 |
|
95 |
-
| 0.0293 | 43.0 | 7826 | 0.8597 | 0.8307 |
|
96 |
-
| 0.027 | 44.0 | 8008 | 0.8641 | 0.8286 |
|
97 |
-
| 0.0242 | 45.0 | 8190 | 0.8795 | 0.8300 |
|
98 |
-
| 0.0196 | 46.0 | 8372 | 0.8684 | 0.8286 |
|
99 |
-
| 0.0175 | 47.0 | 8554 | 0.8710 | 0.8279 |
|
100 |
-
| 0.022 | 48.0 | 8736 | 0.8773 | 0.8259 |
|
101 |
-
| 0.0149 | 49.0 | 8918 | 0.8780 | 0.8279 |
|
102 |
-
| 0.0195 | 50.0 | 9100 | 0.8778 | 0.8279 |
|
103 |
|
104 |
|
105 |
### Framework versions
|
|
|
18 |
|
19 |
This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
+
- Loss: 0.5795
|
22 |
+
- Accuracy: 0.8630
|
23 |
|
24 |
## Model description
|
25 |
|
|
|
38 |
### Training hyperparameters
|
39 |
|
40 |
The following hyperparameters were used during training:
|
41 |
+
- learning_rate: 3e-05
|
42 |
+
- train_batch_size: 64
|
43 |
+
- eval_batch_size: 64
|
44 |
- seed: 42
|
45 |
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
46 |
- lr_scheduler_type: linear
|
47 |
+
- num_epochs: 15
|
48 |
|
49 |
### Training results
|
50 |
|
51 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|
52 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
|
53 |
+
| 1.435 | 1.0 | 106 | 1.1905 | 0.7450 |
|
54 |
+
| 0.8006 | 2.0 | 212 | 0.7220 | 0.8152 |
|
55 |
+
| 0.5227 | 3.0 | 318 | 0.5708 | 0.8406 |
|
56 |
+
| 0.4252 | 4.0 | 424 | 0.5011 | 0.8501 |
|
57 |
+
| 0.3078 | 5.0 | 530 | 0.4905 | 0.8506 |
|
58 |
+
| 0.2471 | 6.0 | 636 | 0.5174 | 0.8447 |
|
59 |
+
| 0.1752 | 7.0 | 742 | 0.5095 | 0.8589 |
|
60 |
+
| 0.2241 | 8.0 | 848 | 0.5265 | 0.8524 |
|
61 |
+
| 0.1165 | 9.0 | 954 | 0.5525 | 0.8577 |
|
62 |
+
| 0.102 | 10.0 | 1060 | 0.5510 | 0.8512 |
|
63 |
+
| 0.0691 | 11.0 | 1166 | 0.5730 | 0.8577 |
|
64 |
+
| 0.0809 | 12.0 | 1272 | 0.5670 | 0.8619 |
|
65 |
+
| 0.0631 | 13.0 | 1378 | 0.5715 | 0.8625 |
|
66 |
+
| 0.0589 | 14.0 | 1484 | 0.5756 | 0.8625 |
|
67 |
+
| 0.0628 | 15.0 | 1590 | 0.5795 | 0.8630 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
68 |
|
69 |
|
70 |
### Framework versions
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 267937160
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d07ae015aae003d01f97b5a1a3c9e3dc364765b7cc7eff695ee3035d9cf0ac56
|
3 |
size 267937160
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5240
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c863f887a899b47469fab8a8080de592e8d9b33244add6965c6e3f9fe01692d9
|
3 |
size 5240
|