Google Research, New York
Ziteng Sun, Ananda Theertha Suresh, Jae Hun Ro, Ahmad Beirami, Himanshu Jain, Felix Yu
autoregressive sampling; computation efficiency; optimal transport
SpecTr: Fast Speculative Decoding via Optimal Transport