cs.CL cs.AI
Falcon: Faster and Parallel Inference of Large Language Models through Enhanced Semi-Autoregressive Drafting and Custom-Designed Decoding Tree
Xiangxiang Gao Weisheng Xie Yiwei Xiang Feng Ji