University of Texas at Austin; University of Texas at Austin, Eindhoven University of Technology
AJAY JAISWAL, Shiwei Liu, Shiwei Liu, Tianlong Chen, Tianlong Chen, Zhangyang "Atlas" Wang
Pre-trained Models;Sparsity;Emergence;Transformers;Pruning
The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter