Hugging Face's logo

lapp0
/
distily_bench_gpt2_simple_objectives2

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
2f544aa
·
verified ·
1 Parent(s): 1be3a21

Training in progress, step 24750

Browse files
Files changed (4) hide show
  1. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.1__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_/events.out.tfevents.1723477047.93d6cbb3ad53 +3 -0
  2. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn/events.out.tfevents.1723476868.93d6cbb3ad53 +2 -2
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.1__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_/events.out.tfevents.1723477047.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ff6077ad667b7e2382be2dde60d0ef6d544d44aa2b633f50cc6df35c05902a
3
+ size 5607523
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_fn/events.out.tfevents.1723476868.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d891d384d284aac7cab80925dc0781170703f1ac9e1df38e3f8f949dd8da34d1
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f24c179e23b1d19c12c8696f039953056e9ada31c488df4b73b2df2a7533aed2
3
+ size 529
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:76012051ec61bc658e4eafac6e4ca87eef8aa2596a92c3a97ec369242824f595
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:987c1c90fca538e8947b68daf6ee9b83d005dd4ad326556e36adfcbc6cc028ad
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ef7493874be41614d9b829097701e19893ccd114c99c94e487bf72435e3e034
3
  size 907106756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ed71e17a90c7a754789d58098ca6e4a8d0b69ac3e80155bbc13684250748cc2
3
  size 907106756