University of Washington; University of Washington, Allen Institute for AI
sequence modeling;input representations;language modeling;word embedding
DeFINE: Deep Factorized Input Token Embeddings for Neural Sequence Modeling