Yermalovich commited on
Commit
ea50d2a
·
verified ·
1 Parent(s): 3c09b61

TrainingLLM_Med_Bio_ClinicalBERT_LastOne

Browse files
Files changed (2) hide show
  1. README.md +8 -8
  2. model.safetensors +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.1850
20
 
21
  ## Model description
22
 
@@ -51,13 +51,13 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:-----:|:---------------:|
54
- | 2.7164 | 1.0 | 1641 | 2.8099 |
55
- | 2.5918 | 2.0 | 3282 | 2.4808 |
56
- | 2.3024 | 3.0 | 4923 | 2.3089 |
57
- | 2.2511 | 4.0 | 6564 | 2.2244 |
58
- | 1.9932 | 5.0 | 8205 | 2.1818 |
59
- | 2.0509 | 6.0 | 9846 | 2.1629 |
60
- | 2.0266 | 7.0 | 11487 | 2.1850 |
61
 
62
 
63
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 2.1180
20
 
21
  ## Model description
22
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:-----:|:-----:|:---------------:|
54
+ | 2.6815 | 1.0 | 1641 | 2.7701 |
55
+ | 2.5815 | 2.0 | 3282 | 2.4848 |
56
+ | 2.2428 | 3.0 | 4923 | 2.2418 |
57
+ | 2.1742 | 4.0 | 6564 | 2.1479 |
58
+ | 1.9289 | 5.0 | 8205 | 2.1018 |
59
+ | 1.9889 | 6.0 | 9846 | 2.0961 |
60
+ | 1.9789 | 7.0 | 11487 | 2.1180 |
61
 
62
 
63
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72f07526beaa0de3b2f29c0e6d1872a1bbb012305cbe97d4467891fb6a9e1471
3
  size 433386912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1736d51e74ab1e6989eede0de6634b2d2b09675f276032f190b47b7b8b3d2030
3
  size 433386912