Department of Data Science & AI, Monash University, Australia
Jing Liu, Zizheng Pan, Haoyu He, Jianfei Cai, Bohan Zhuang
Energy-efficient Attention;Linear Complexity;Transformer;Binarization;Hashing
EcoFormer: Energy-Saving Attention with Linear Complexity