Beidi Chen, Tri Dao, Kaizhao Liang, Jiaming Yang, Zhao Song, Atri Rudra, Christopher Re
Sparse training;butterfly;low-rank;Lottery Tickets;Block sparsity;Hashing;Transformer;ViT;MLP-Mixer
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models