End of training

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 3.0422
+- Loss: 1.9593
 
 ## Model description
 
@@ -40,27 +40,37 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 10
+- num_epochs: 20
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |
-|:-------------:|:-----:|:----:|:---------------:|
-| 5.5859        | 1.0   | 771  | 4.8795          |
-| 4.6342        | 2.0   | 1542 | 4.4347          |
-| 4.2562        | 3.0   | 2313 | 4.0613          |
-| 3.7564        | 4.0   | 3084 | 3.7838          |
-| 3.3958        | 5.0   | 3855 | 3.5664          |
-| 2.919         | 6.0   | 4626 | 3.3792          |
-| 2.6039        | 7.0   | 5397 | 3.2393          |
-| 2.1531        | 8.0   | 6168 | 3.1331          |
-| 1.9531        | 9.0   | 6939 | 3.0656          |
-| 1.6577        | 10.0  | 7710 | 3.0422          |
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 5.8353        | 1.0   | 651   | 4.8999          |
+| 4.8713        | 2.0   | 1302  | 4.4407          |
+| 4.4876        | 3.0   | 1953  | 4.0638          |
+| 3.7647        | 4.0   | 2604  | 3.7308          |
+| 3.3969        | 5.0   | 3255  | 3.4360          |
+| 3.1115        | 6.0   | 3906  | 3.1895          |
+| 2.4283        | 7.0   | 4557  | 2.9595          |
+| 2.0813        | 8.0   | 5208  | 2.7442          |
+| 1.7785        | 9.0   | 5859  | 2.5330          |
+| 1.3337        | 10.0  | 6510  | 2.3619          |
+| 1.066         | 11.0  | 7161  | 2.2079          |
+| 0.9607        | 12.0  | 7812  | 2.1072          |
+| 0.8078        | 13.0  | 8463  | 2.0385          |
+| 0.6072        | 14.0  | 9114  | 1.9966          |
+| 0.5351        | 15.0  | 9765  | 1.9736          |
+| 0.5049        | 16.0  | 10416 | 1.9646          |
+| 0.3958        | 17.0  | 11067 | 1.9607          |
+| 0.346         | 18.0  | 11718 | 1.9592          |
+| 0.3244        | 19.0  | 12369 | 1.9565          |
+| 0.2777        | 20.0  | 13020 | 1.9593          |
 
 
 ### Framework versions
 
-- Transformers 4.40.1
+- Transformers 4.40.2
 - Pytorch 2.2.1+cu121
 - Datasets 2.19.1
 - Tokenizers 0.19.1

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 50256,
   "eos_token_id": 50256,
-  "transformers_version": "4.40.1"
+  "transformers_version": "4.40.2"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:883f70bef407d1d549b7db9f2810471e9339acf07caafb3105587ee14bc28afc
+oid sha256:0c1b0b44936db0770f1e9d25980c8dc97b166de0c58e05da1ee2bf1c24904c49
 size 497774208

runs/May10_00-28-10_536d6c36922d/events.out.tfevents.1715300897.536d6c36922d.154.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c44211d058c4d8059c982ca77bda971b2234a100577463ac1ed565dd87696f34
-size 15546
+oid sha256:2a0b35945ecafb20ff2fce7681403a22f219dc3260a00bcd9fe8ce1d13b729ff
+size 16171