notmaineyy commited on
Commit
38b0f9f
·
1 Parent(s): e8cbd6f

Training in progress epoch 0

Browse files
README.md CHANGED
@@ -14,13 +14,13 @@ probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.0109
18
- - Validation Loss: 0.0246
19
- - Train Precision: 0.9362
20
- - Train Recall: 0.9416
21
- - Train F1: 0.9389
22
- - Train Accuracy: 0.9937
23
- - Epoch: 2
24
 
25
  ## Model description
26
 
@@ -39,16 +39,14 @@ More information needed
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 15648, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
43
  - training_precision: float32
44
 
45
  ### Training results
46
 
47
  | Train Loss | Validation Loss | Train Precision | Train Recall | Train F1 | Train Accuracy | Epoch |
48
  |:----------:|:---------------:|:---------------:|:------------:|:--------:|:--------------:|:-----:|
49
- | 0.0631 | 0.0387 | 0.8765 | 0.9074 | 0.8917 | 0.9881 | 0 |
50
- | 0.0241 | 0.0288 | 0.9328 | 0.9274 | 0.9301 | 0.9918 | 1 |
51
- | 0.0109 | 0.0246 | 0.9362 | 0.9416 | 0.9389 | 0.9937 | 2 |
52
 
53
 
54
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.1277
18
+ - Validation Loss: 0.0691
19
+ - Train Precision: 0.9077
20
+ - Train Recall: 0.9281
21
+ - Train F1: 0.9178
22
+ - Train Accuracy: 0.9808
23
+ - Epoch: 0
24
 
25
  ## Model description
26
 
 
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
+ - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 10530, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
43
  - training_precision: float32
44
 
45
  ### Training results
46
 
47
  | Train Loss | Validation Loss | Train Precision | Train Recall | Train F1 | Train Accuracy | Epoch |
48
  |:----------:|:---------------:|:---------------:|:------------:|:--------:|:--------------:|:-----:|
49
+ | 0.1277 | 0.0691 | 0.9077 | 0.9281 | 0.9178 | 0.9808 | 0 |
 
 
50
 
51
 
52
  ### Framework versions
config.json CHANGED
@@ -16,7 +16,9 @@
16
  "3": "LABEL_3",
17
  "4": "LABEL_4",
18
  "5": "LABEL_5",
19
- "6": "LABEL_6"
 
 
20
  },
21
  "initializer_range": 0.02,
22
  "intermediate_size": 3072,
@@ -27,7 +29,9 @@
27
  "LABEL_3": 3,
28
  "LABEL_4": 4,
29
  "LABEL_5": 5,
30
- "LABEL_6": 6
 
 
31
  },
32
  "layer_norm_eps": 1e-12,
33
  "max_position_embeddings": 512,
 
16
  "3": "LABEL_3",
17
  "4": "LABEL_4",
18
  "5": "LABEL_5",
19
+ "6": "LABEL_6",
20
+ "7": "LABEL_7",
21
+ "8": "LABEL_8"
22
  },
23
  "initializer_range": 0.02,
24
  "intermediate_size": 3072,
 
29
  "LABEL_3": 3,
30
  "LABEL_4": 4,
31
  "LABEL_5": 5,
32
+ "LABEL_6": 6,
33
+ "LABEL_7": 7,
34
+ "LABEL_8": 8
35
  },
36
  "layer_norm_eps": 1e-12,
37
  "max_position_embeddings": 512,
logs/train/events.out.tfevents.1658393740.c2f2cab6445b.70.0.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5147f281f2017209c3f8db9510e3336b965f743ee71641c88e4c994107b47dc
3
+ size 3138974
logs/validation/events.out.tfevents.1658394246.c2f2cab6445b.70.1.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9d5d9dd85e43611cafa223d756edd4672262b7cfa3188550a43c36911d6a204
3
+ size 194
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e58299e713d4fd4ca4a98e0f8f139b3bbedf786cf37004a587e19d7b8680b039
3
- size 709346340
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8e8fb850d66e07283a208609d9488d5195f3b86a3b11b9874ba573b7360387e
3
+ size 709364780