Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712; Department of Statistics and Data Sciences, The University of Texas at Austin, Austin, TX 78712; Department of Computer Science, The University of Texas at Austin, Austin, TX 78712
Huy Nguyen, Pedram Akbarian Saravi, Fanqi Yan, Nhat Ho
Mixture of Experts;Maximum Likelihood Estimation;Voronoi Loss Function
Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts