Mila, Montreal Neurological Institute & McGill University, Montréal, QC, Canada; Learning in Machines and Brains Program, CIFAR, Toronto, ON, Canada; UC Berkeley, CA, USA; Mila & McGill University, Montréal, QC, Canada
Kumar K Agrawal, Arnab Kumar Mondal, Arna Ghosh, Blake Richards
Representation analysis;Representation learning;Self Supervised Learning;Eigenspectrum;Overparameterized Linear regression;Computer vision;Model Selection
$\alpha$-ReQ : Assessing Representation Quality in Self-Supervised Learning by measuring eigenspectrum decay