University of Texas at Austin; JD Explore Academy; Eindhoven University of Technology; University of Twente
Shiwei Liu, Tianlong Chen, Xiaohan Chen, Li Shen, Decebal Mocanu, Zhangyang Wang, Mykola Pechenizkiy
random pruning;sparse training;static sparse training;layer-wise sparsities;dynamic sparse training
The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training