Stanford University; Physics & Informatics Laboratories, NTT Research, Inc.
Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli, Daniel L Yamins, Hidenori Tanaka
learning dynamics;symmetry;loss landscape;stochastic differential equation;modified equation analysis;conservation law;hessian;geometry;physics;gradient flow
Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics