Mila, University of Montreal; MIT-IBM Watson AI Lab
efficient UT;transformers;sparse moe;conditional computation;NLP;wmt14;cfq;compositional generalization;natural language processing;sparse
Sparse Universal Transformer