University of Toronto, Toronto, Canada; Shanghai Jiao Tong University, Shanghai, China; Vector Institute, Toronto, Canada
Muralidhar Andoorveedu, Zhanda Zhu, Bojian Zheng, Gennady Pekhimenko
Implementation;Systems;Transformers
Tempo: Accelerating Transformer-Based Model Training through Memory Footprint Reduction