Department of Applied Mathematics, School of Mathematical Sciences, Tel Aviv University, Tel Aviv 69978, Israel; Hebrew University, Racah Institute of Physics, Jerusalem, 9190401, Israel
Noa Rubin, Inbar Seroussi, Zohar Ringel
Grokking;deep neural networks;Gaussian Process;phase transitions
Grokking as a First Order Phase Transition in Two Layer Networks