kornellewy commited on
Commit
52bd769
·
verified ·
1 Parent(s): ec5d8ea

gpt_SmallEfficientModel_round1_iter2_loss_average

Browse files
training_summary_gpt_SmallEfficientModel_round1_iter2_loss_average.txt ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Model: gpt_SmallEfficientModel
2
+ Optimizer: adamw, LR: 2e-05
3
+ Best Val Loss: 3.6362, Test Loss: 3.6421
4
+ Epoch 1: Train Loss: 0.2744, Val Loss: 4.0079
5
+ Epoch 2: Train Loss: 0.2489, Val Loss: 3.9518
6
+ Epoch 3: Train Loss: 0.2453, Val Loss: 3.8867
7
+ Epoch 4: Train Loss: 0.2400, Val Loss: 3.7853
8
+ Epoch 5: Train Loss: 0.2345, Val Loss: 3.7175
9
+ Epoch 6: Train Loss: 0.2311, Val Loss: 3.6740
10
+ Epoch 7: Train Loss: 0.2292, Val Loss: 3.6579
11
+ Epoch 8: Train Loss: 0.2283, Val Loss: 3.6433
12
+ Epoch 9: Train Loss: 0.2278, Val Loss: 3.6362
13
+ Epoch 10: Train Loss: 0.2276, Val Loss: 3.6429
14
+ Final Test Loss: 3.6421