École Polytechnique Fédérale de Lausanne (EPFL), Switzerland; Raymond and Beverly Sackler School of Physics and Astronomy, Tel-Aviv University, Tel-Aviv 69978, Israel
Noam Levi, Alon Beck, Yohai Bar-Sinai
Grokking;Random Matrix Theory;Linear Regression;Representation Learning
Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding