Department of Physics, John A. Paulson School of Engineering and Applied Sciences, Center for Brain Science, Harvard University, Cambridge, MA 02138, USA; John A. Paulson School of Engineering and Applied Sciences, Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
Alexander Atanasov, Blake Bordelon, Sabarish Sainathan, Cengiz Pehlevan
Feature Learning;Neural Tangent Kernel;Scaling Laws;Deep Ensembles
The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes