cs.LG
FastAttention: Extend FlashAttention2 to NPUs and Low-resource GPUs
Haoran Lin Xianzhi Yu Kang Zhao Lu Hou Zongyuan Zhan Stanislav Kamenev Han Bao Ting Hu Mingkai Wang Qixin Chang Siyue Sui Weihao Sun Jiaxin Hu Jun Yao Zekun Yin Cheng Qian Ying Zhang Yinfei Pan Yu Yang Weiguo Liu