University of Maryland; Google Research
Chen Zhu, Renkun Ni, Zheng Xu, Kezhi Kong, W. Ronny Huang, Tom Goldstein
Initialization;Transformers;Convolutional Networks
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training