Meta AI (FAIR); Carnegie Mellon University; Zhe Jiang University; Rice University; Adobe Research; Stanford University; University of California, San Diego; ETH Zurich
Zichang Liu, Jue Wang, Tri Dao, Tianyi Zhou, Binhang Yuan, Zhao Song, Anshumali Shrivastava, Ce Zhang, Yuandong Tian, Christopher Ré, Beidi Chen
Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time