Microsoft Research Asia; University of Science and Technology of China; University of Chinese Academy of Sciences
Qi Meng, Shuxin Zheng, Huishuai Zhang, Wei Chen, Qiwei Ye, Zhi-Ming Ma, Nenghai Yu, Tie-Yan Liu
optimization;neural network;irreducible positively scale-invariant space;deep learning
G-SGD: Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space