Computer Science, University of California, Los Angeles
Pratik A Chaudhari, Stefano Soatto
sgd;variational inference;gradient noise;out-of-equilibrium
Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks