End of training

README.md

@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [ahxt/LiteLlama-460M-1T](https://huggingface.co/ahxt/LiteLlama-460M-1T) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.3021
+- Loss: 2.0471
 
 ## Model description
 
@@ -46,18 +46,24 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.03
-- num_epochs: 5
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 4.1436        | 0.8   | 25   | 3.8815          |
-| 3.6028        | 1.6   | 50   | 3.2639          |
-| 2.9395        | 2.4   | 75   | 2.5905          |
-| 2.4548        | 3.2   | 100  | 2.3582          |
-| 2.337         | 4.0   | 125  | 2.3102          |
-| 2.3125        | 4.8   | 150  | 2.3024          |
+| 4.1747        | 0.8   | 25   | 3.9257          |
+| 3.626         | 1.6   | 50   | 3.2474          |
+| 2.8441        | 2.4   | 75   | 2.4490          |
+| 2.3365        | 3.2   | 100  | 2.2482          |
+| 2.2153        | 4.0   | 125  | 2.1758          |
+| 2.1591        | 4.8   | 150  | 2.1316          |
+| 2.1214        | 5.6   | 175  | 2.1011          |
+| 2.0946        | 6.4   | 200  | 2.0781          |
+| 2.0818        | 7.2   | 225  | 2.0622          |
+| 2.0614        | 8.0   | 250  | 2.0528          |
+| 2.0571        | 8.8   | 275  | 2.0485          |
+| 2.0522        | 9.6   | 300  | 2.0471          |
 
 
 ### Framework versions

runs/Aug03_09-18-38_fastgpuserv/events.out.tfevents.1722690531.fastgpuserv.2914688.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01f6462e33b14e20a451c94459665f31bb87ad7d037deac0f025e8b117299d64
+size 359