Spaces:

TraceForce
/

varun-kd-finetune

Sleeping

Varun Wadhwa commited on Jan 14

Commit

1f7e238

unverified ·

1 Parent(s): 2343812

Logs

Files changed (1) hide show

app.py CHANGED Viewed

@@ -201,7 +201,7 @@ def distillation_loss(student_logits, teacher_logits, true_labels, temperature,
 # hyperparameters
 batch_size = 32
 lr = 1e-4
-num_epochs = 30
 temperature = 2.0
 alpha = 0.5

 # hyperparameters
 batch_size = 32
 lr = 1e-4
+num_epochs = 15
 temperature = 2.0
 alpha = 0.5