Google; Carnegie Mellon University
Lijun Yu, Yong Cheng, Zhiruo Wang, Vivek Kumar, Wolfgang Macherey, Yanping Huang, David Ross, Irfan Essa, Yonatan Bisk, Ming-Hsuan Yang, Kevin Murphy, Alexander Hauptmann, Lu Jiang, Lu Jiang
multimodal;generation;large language model
SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs