Model save

README.md

@@ -3,10 +3,9 @@ library_name: transformers
 license: apache-2.0
 base_model: PlanTL-GOB-ES/bsc-bio-ehr-es
 tags:
-- token-classification
 - generated_from_trainer
 datasets:
-- Rodrigo1771/drugtemist-85-ner
+- combined-train-distemist-dev-85-ner
 metrics:
 - precision
 - recall
@@ -19,24 +18,24 @@ model-index:
       name: Token Classification
       type: token-classification
     dataset:
-      name: Rodrigo1771/drugtemist-85-ner
-      type: Rodrigo1771/drugtemist-85-ner
-      config: DrugTEMIST NER
+      name: combined-train-distemist-dev-85-ner
+      type: combined-train-distemist-dev-85-ner
+      config: CombinedTrainDisTEMISTDevNER
       split: validation
-      args: DrugTEMIST NER
+      args: CombinedTrainDisTEMISTDevNER
     metrics:
     - name: Precision
       type: precision
-      value: 0.9461187214611873
+      value: 0.31162999550965426
     - name: Recall
       type: recall
-      value: 0.9522058823529411
+      value: 0.8118858212447356
     - name: F1
       type: f1
-      value: 0.9491525423728814
+      value: 0.45038613797131544
     - name: Accuracy
       type: accuracy
-      value: 0.9989426998228679
+      value: 0.8533304955579661
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -44,13 +43,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 # output
 
-This model is a fine-tuned version of [PlanTL-GOB-ES/bsc-bio-ehr-es](https://huggingface.co/PlanTL-GOB-ES/bsc-bio-ehr-es) on the Rodrigo1771/drugtemist-85-ner dataset.
+This model is a fine-tuned version of [PlanTL-GOB-ES/bsc-bio-ehr-es](https://huggingface.co/PlanTL-GOB-ES/bsc-bio-ehr-es) on the combined-train-distemist-dev-85-ner dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0048
-- Precision: 0.9461
-- Recall: 0.9522
-- F1: 0.9492
-- Accuracy: 0.9989
+- Loss: 1.0023
+- Precision: 0.3116
+- Recall: 0.8119
+- F1: 0.4504
+- Accuracy: 0.8533
 
 ## Model description
 
@@ -83,16 +82,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| No log        | 1.0   | 466  | 0.0031          | 0.9292    | 0.9412 | 0.9352 | 0.9989   |
-| 0.0199        | 2.0   | 932  | 0.0031          | 0.9212    | 0.9568 | 0.9387 | 0.9989   |
-| 0.0026        | 3.0   | 1398 | 0.0040          | 0.9365    | 0.9357 | 0.9361 | 0.9989   |
-| 0.0011        | 4.0   | 1864 | 0.0052          | 0.9400    | 0.9219 | 0.9309 | 0.9987   |
-| 0.001         | 5.0   | 2330 | 0.0048          | 0.9461    | 0.9522 | 0.9492 | 0.9989   |
-| 0.0005        | 6.0   | 2796 | 0.0046          | 0.9376    | 0.9522 | 0.9448 | 0.9989   |
-| 0.0004        | 7.0   | 3262 | 0.0050          | 0.9328    | 0.9568 | 0.9446 | 0.9990   |
-| 0.0002        | 8.0   | 3728 | 0.0055          | 0.9423    | 0.9449 | 0.9436 | 0.9989   |
-| 0.0001        | 9.0   | 4194 | 0.0057          | 0.9399    | 0.9485 | 0.9442 | 0.9989   |
-| 0.0001        | 10.0  | 4660 | 0.0058          | 0.9348    | 0.9485 | 0.9416 | 0.9989   |
+| 0.3191        | 1.0   | 541  | 0.4772          | 0.2725    | 0.8074 | 0.4075 | 0.8443   |
+| 0.1619        | 2.0   | 1082 | 0.4584          | 0.3041    | 0.7941 | 0.4398 | 0.8553   |
+| 0.11          | 3.0   | 1623 | 0.6447          | 0.2976    | 0.8000 | 0.4338 | 0.8435   |
+| 0.0764        | 4.0   | 2164 | 0.7413          | 0.2896    | 0.7871 | 0.4234 | 0.8399   |
+| 0.0567        | 5.0   | 2705 | 0.7006          | 0.3153    | 0.8145 | 0.4546 | 0.8565   |
+| 0.0428        | 6.0   | 3246 | 0.8112          | 0.3071    | 0.8210 | 0.4470 | 0.8504   |
+| 0.0332        | 7.0   | 3787 | 0.9046          | 0.3114    | 0.8070 | 0.4494 | 0.8533   |
+| 0.0257        | 8.0   | 4328 | 0.9723          | 0.3060    | 0.8109 | 0.4444 | 0.8482   |
+| 0.022         | 9.0   | 4869 | 1.0028          | 0.3087    | 0.8077 | 0.4467 | 0.8502   |
+| 0.0181        | 10.0  | 5410 | 1.0023          | 0.3116    | 0.8119 | 0.4504 | 0.8533   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fb05d214814c2ef6801e19a47050c4e071f9a6a53f337eecc64972e6bf739330
+oid sha256:40d51e380730dc13252fa24e75ff6a3a5d47dfbaa6ff5f8a7a801628c757ba77
 size 496262556

tb/events.out.tfevents.1725579443.2a66098fac87.15776.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bbe3f5ff4851f3fc3c5cabd01bde5b3d622ecd3b108e014532660173b1a056f1
-size 11819
+oid sha256:c35cf63ce2a6e730611e5daee2288691541b634908c8c8e2a1a19a4eb706abe0
+size 12645

train.log

@@ -1482,3 +1482,16 @@ Training completed. Do not forget to share your model on huggingface.co/models =
 [INFO|trainer.py:2632] 2024-09-06 00:03:12,782 >> Loading best model from /content/dissertation/scripts/ner/output/checkpoint-2705 (score: 0.45455732567249935).
 
                                                   
 [INFO|trainer.py:4283] 2024-09-06 00:03:12,976 >> Waiting for the current checkpoint push to be finished, this might take a couple of minutes.
+[INFO|trainer.py:3503] 2024-09-06 00:03:38,550 >> Saving model checkpoint to /content/dissertation/scripts/ner/output
+[INFO|configuration_utils.py:472] 2024-09-06 00:03:38,551 >> Configuration saved in /content/dissertation/scripts/ner/output/config.json
+[INFO|modeling_utils.py:2799] 2024-09-06 00:03:39,925 >> Model weights saved in /content/dissertation/scripts/ner/output/model.safetensors
+[INFO|tokenization_utils_base.py:2684] 2024-09-06 00:03:39,926 >> tokenizer config file saved in /content/dissertation/scripts/ner/output/tokenizer_config.json
+[INFO|tokenization_utils_base.py:2693] 2024-09-06 00:03:39,926 >> Special tokens file saved in /content/dissertation/scripts/ner/output/special_tokens_map.json
+[INFO|trainer.py:3503] 2024-09-06 00:03:39,973 >> Saving model checkpoint to /content/dissertation/scripts/ner/output
+[INFO|configuration_utils.py:472] 2024-09-06 00:03:39,975 >> Configuration saved in /content/dissertation/scripts/ner/output/config.json
+[INFO|modeling_utils.py:2799] 2024-09-06 00:03:41,523 >> Model weights saved in /content/dissertation/scripts/ner/output/model.safetensors
+[INFO|tokenization_utils_base.py:2684] 2024-09-06 00:03:41,524 >> tokenizer config file saved in /content/dissertation/scripts/ner/output/tokenizer_config.json
+[INFO|tokenization_utils_base.py:2693] 2024-09-06 00:03:41,524 >> Special tokens file saved in /content/dissertation/scripts/ner/output/special_tokens_map.json
+{'eval_loss': 1.0022608041763306, 'eval_precision': 0.31162999550965426, 'eval_recall': 0.8118858212447356, 'eval_f1': 0.45038613797131544, 'eval_accuracy': 0.8533304955579661, 'eval_runtime': 14.4559, 'eval_samples_per_second': 471.089, 'eval_steps_per_second': 58.938, 'epoch': 10.0}
+{'train_runtime': 1549.44, 'train_samples_per_second': 223.332, 'train_steps_per_second': 3.492, 'train_loss': 0.0812657987344287, 'epoch': 10.0}
+