IBM T. J. Watson Research Center, Yorktown Heights, NY 10598, USA
Naigang Wang, Chi-Chun (Charlie) Liu, Swagath Venkataramani, Sanchari Sen, Chia-Yu Chen, Kaoutar El Maghraoui, Vijayalakshmi (Viji) Srinivasan, Leland Chang
Quantization;Sparsity;Pruning;Pre-trained;Transformer;Foundation Model;Inference;NLP;vision;speech;BERT;Wav2vec;ViT
Deep Compression of Pre-trained Transformer Models