Princeton University; University of Michigan; University of Washington; Toyota Technological Institute at Chicago; Stanford University
Kaifeng Lyu, Jikai Jin, Zhiyuan Li, Simon Du, Jason Lee, Wei Hu
grokking;implicit bias;margin;kernel;training dynamics;generalization
Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking