University of Texas at Austin; Georgia Institute of Technology; Protagolabs Inc; Texas A&M University; Microsoft Research
hanxue liang, Zhiwen Fan, Rishov Sarkar, Ziyu Jiang, Tianlong Chen, Kai Zou, Yu Cheng, Cong Hao, Zhangyang Wang
multi-task learning;mixture of experts;vision transformer;hardware co-design
M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design