Unversite de Montr ´eal & Mila-Quebec AI Institute, Montr ´eal, QC, Canada; University of Pennsylvania, Philadelphia, PA, USA; CIFAR Learning in Machines & Brains, Toronto, ON, Canada; University of Washington, Seattle, WA, USA; Mila-Quebec AI Institute, Montr ´eal, QC, Canada; McGill University, Mila-Quebec AI Institute & Montreal Neurological Institute, Montr ´eal, QC, Canada; CIFAR Learning in Machines & Brains, Toronto, ON, Canada; McGill University & Mila-Quebec AI Institute, Montr ´eal, QC, Canada
Arna Ghosh, Yuhan Helena Liu, Guillaume Lajoie, Konrad P Kording, Blake A Richards
Computational Neuroscience;learning and plasticity;Credit assignment;Imperfect gradient descent;Gradient approximation;Biologically-plausible learning;Neuromorphic computing;Neural networks
How gradient estimator variance and bias impact learning in neural networks