University of Science and Technology of China; National University of Singapore
Joya Chen, Kai Xu, Yuhui Wang, Yifei Cheng, Angela Yao
dropping intermediate tensors;dropping activations;activation compressed training;top-k;vision transformer;cnn
DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training