Princeton University and Institute for Advanced Study; Tsinghus University; Princeton University
Sanjeev Arora, Zhiyuan Li, Kaifeng Lyu
batch normalization;scale invariance;learning rate;stationary point
Theoretical Analysis of Auto Rate-Tuning by Batch Normalization