cs.LG
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts
Qizhen Zhang Nikolas Gritsch Dwaraknath Gnaneshwar Simon Guo David Cairuz Bharat Venkitesh Jakob Nicolaus Foerster Phil Blunsom Sebastian Ruder Ahmet Üstün Acyr Locatelli