swkong commited on
Commit
334a8d6
·
verified ·
1 Parent(s): 25796d6

Model save

Browse files
Files changed (1) hide show
  1. README.md +9 -5
README.md CHANGED
@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [microsoft/Phi-3-medium-128k-instruct](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 2.0599
22
 
23
  ## Model description
24
 
@@ -46,15 +46,19 @@ The following hyperparameters were used during training:
46
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_ratio: 0.1
49
- - num_epochs: 5
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
- | No log | 1.4023 | 30 | 2.3764 |
56
- | No log | 2.8046 | 60 | 2.1774 |
57
- | No log | 4.2299 | 90 | 2.0599 |
 
 
 
 
58
 
59
 
60
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [microsoft/Phi-3-medium-128k-instruct](https://huggingface.co/microsoft/Phi-3-medium-128k-instruct) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 1.3389
22
 
23
  ## Model description
24
 
 
46
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
47
  - lr_scheduler_type: linear
48
  - lr_scheduler_warmup_ratio: 0.1
49
+ - num_epochs: 10
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:------:|:----:|:---------------:|
55
+ | No log | 1.4023 | 30 | 2.3964 |
56
+ | No log | 2.8046 | 60 | 2.1247 |
57
+ | No log | 4.2299 | 90 | 1.8968 |
58
+ | 2.2305 | 5.6322 | 120 | 1.7274 |
59
+ | 2.2305 | 7.0575 | 150 | 1.5368 |
60
+ | 2.2305 | 8.4598 | 180 | 1.3934 |
61
+ | 1.5516 | 9.8621 | 210 | 1.3389 |
62
 
63
 
64
  ### Framework versions