Microsoft Research Asia; National Key Laboratory for Multimedia Information Processing, Peking University; School of Software & Microelectronics, Peking University; National Key Laboratory for Multimedia Information Processing, Peking University; School of Computer Science, Peking University
speculative decoding;efficient seq2seq generation
Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation