Carnegie Mellon University; Carnegie Mellon University and Bosch AI; Carnegie Mellon University and Determined AI
Jeremy Cohen, Simran Kaur, Yuanzhi Li, Zico Kolter, Ameet Talwalkar
optimization;trajectory;stability;sharpness;implicit bias;implicit regularization;L-smoothness;deep learning theory;science of deep learning
Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability