Meta AI (FAIR); University of Texas at Austin; University of California, Berkeley; Carnegie Mellon University; Adobe Research; Stanford University; University of California, San Diego
Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark Barrett, Zhangyang "Atlas" Wang, Beidi Chen
Large Language Models; Efficient Generative Inference
H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models