early phase of training;implicit regularization;SGD;learning rate;batch size;Hessian;Fisher Information Matrix;curvature;gradient norm
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization