Yandex; Stanford University; Meta; ETH Zurich; UC Berkeley
Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Ré, Ion Stoica, Ce Zhang
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU