Facebook AI Research; University of Washington; University of Washington, Allen Institute for AI; University of Washington, Facebook AI Research
Sachin Mehta, Marjan Ghazvininejad, Srini Iyer, Luke Zettlemoyer, Hannaneh Hajishirzi
Transformers;Sequence Modeling;Machine Translation;Language Modeling;Representation learning;Efficient Networks
DeLighT: Deep and Light-weight Transformer