Department of Computer Science and Engineering, University of Notre Dame; Department of Computer Science, ETH Zürich
Brian DuSell, David Chiang
transformer;attention;context-free languages;pushdown automata;formal languages;language modeling;machine translation
Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns