Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR), Singapore; Institute of Computing Technology, Chinese Academy of Sciences
Wei Ming Neo, Zhehui Wang, Cheng Liu, Rick Goh, Tao Luo
BERT;Efficient inference;Matrix arithmetic-only;Eleminate non-linear functions
MA-BERT: Towards Matrix Arithmetic-only BERT Inference by Eliminating Complex Non-Linear Functions