Cognitive Computing Lab, Baidu Research; Department of Physics, Hong Kong Baptist University
Zeke Xie, Qian-Yuan Tang, Mingming Sun, Ping Li
Gradient Noise;SGD;Deep Learning;Heavy Tails
On the Overlooked Structure of Stochastic Gradients