Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts
Jawahar, Ganesh Yang, Haichuan Xiong, Yunyang Liu, Zechun Wang, Dilin Sun, Fei Li, Meng Pappu, Aasish Oguz, Barlas Abdul-Mageed, Muhammad Lakshmanan, Laks Krishnamoorthi, Raghuraman Ch ra, Vikas