Inﬁnigence-AI; Department of Electronic Engineering, Tsinghua University, Beijing, China; ESAT-PSI, KU Leuven, Leuven, Belgium; Microsoft Research, Redmond, Washington, USA
Xuefei Ning, Zinan Lin, Zixuan Zhou, Zifu Wang, Huazhong Yang, Yu Wang
large language model;efficient inference;data-centric optimization;parallel generation;prompt engineering;planning
Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation