University of Texas at Austin; MIT-IBM Watson AI Lab; MIT; Columbia University
Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Cox, Zhangyang Wang, Yoon Kim
Transformer;Efficient Training;Model Reuse
Learning to Grow Pretrained Models for Efficient Transformer Training