bbrad
deep learning theory;learning dynamics;neural collapse;back-propagation;low-rank;gradient;rank;theory;dynamics
Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse