xuancoblab2023 commited on
Commit
2aa5d6a
·
verified ·
1 Parent(s): 759cb06

End of training

Browse files
Files changed (2) hide show
  1. README.md +14 -18
  2. model.safetensors +1 -1
README.md CHANGED
@@ -3,8 +3,6 @@ license: apache-2.0
3
  base_model: google/bert_uncased_L-2_H-128_A-2
4
  tags:
5
  - generated_from_trainer
6
- metrics:
7
- - accuracy
8
  model-index:
9
  - name: tiny-bert-sst2-distilled
10
  results: []
@@ -17,8 +15,16 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [google/bert_uncased_L-2_H-128_A-2](https://huggingface.co/google/bert_uncased_L-2_H-128_A-2) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.5066
21
- - Accuracy: 0.8165
 
 
 
 
 
 
 
 
22
 
23
  ## Model description
24
 
@@ -37,23 +43,13 @@ More information needed
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
- - learning_rate: 0.00015135649079170115
41
- - train_batch_size: 128
42
- - eval_batch_size: 128
43
  - seed: 33
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - num_epochs: 4
47
- - mixed_precision_training: Native AMP
48
-
49
- ### Training results
50
-
51
- | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
- |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | 1.235 | 1.0 | 527 | 1.2949 | 0.8417 |
54
- | 0.565 | 2.0 | 1054 | 1.4198 | 0.8303 |
55
- | 0.4043 | 3.0 | 1581 | 1.5066 | 0.8165 |
56
-
57
 
58
  ### Framework versions
59
 
 
3
  base_model: google/bert_uncased_L-2_H-128_A-2
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: tiny-bert-sst2-distilled
8
  results: []
 
15
 
16
  This model is a fine-tuned version of [google/bert_uncased_L-2_H-128_A-2](https://huggingface.co/google/bert_uncased_L-2_H-128_A-2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - eval_loss: 0.4358
19
+ - eval_accuracy: 0.7984
20
+ - eval_recall: 0.9335
21
+ - eval_precision: 0.7350
22
+ - eval_f1: 0.8224
23
+ - eval_runtime: 30.8207
24
+ - eval_samples_per_second: 33.16
25
+ - eval_steps_per_second: 1.038
26
+ - epoch: 2.0
27
+ - step: 192
28
 
29
  ## Model description
30
 
 
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
46
+ - learning_rate: 0.00020749603056740112
47
+ - train_batch_size: 32
48
+ - eval_batch_size: 32
49
  - seed: 33
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 7
 
 
 
 
 
 
 
 
 
 
53
 
54
  ### Framework versions
55
 
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:419986f87659b65247fdff0e0c36b70fb5c6a2a3dcf2ae0b1384ca611734efed
3
  size 17549312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3a75025dd9c90072121cfb7257778cf348e210687840eb3a50bf108d16c101c
3
  size 17549312