TrainingLLM_Med_Bio_ClinicalBERT_Last

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.0625
+- Loss: 2.1850
 
 ## Model description
 
@@ -44,17 +44,20 @@ The following hyperparameters were used during training:
 - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 500
-- num_epochs: 4
+- num_epochs: 7
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |
-|:-------------:|:-----:|:----:|:---------------:|
-| 3.0693        | 1.0   | 1641 | 3.1932          |
-| 3.0998        | 2.0   | 3282 | 3.0964          |
-| 2.873         | 3.0   | 4923 | 3.0659          |
-| 2.9483        | 4.0   | 6564 | 3.0625          |
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 2.7164        | 1.0   | 1641  | 2.8099          |
+| 2.5918        | 2.0   | 3282  | 2.4808          |
+| 2.3024        | 3.0   | 4923  | 2.3089          |
+| 2.2511        | 4.0   | 6564  | 2.2244          |
+| 1.9932        | 5.0   | 8205  | 2.1818          |
+| 2.0509        | 6.0   | 9846  | 2.1629          |
+| 2.0266        | 7.0   | 11487 | 2.1850          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b0c15860df49a2871296c983ad3e0a2fc5754ab3af663270210e1ea7e3191b77
+oid sha256:72f07526beaa0de3b2f29c0e6d1872a1bbb012305cbe97d4467891fb6a9e1471
 size 433386912

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b9569e859494b24c98154d1fcbae84ea70a279bbb8431b5ee0022d43d6b1d159
-size 5304
+oid sha256:08fb0259d855aaa9d4522f92f9804c8bed9b706cdfb3ef7e35dcb65b6ee9835f
+size 5240