University of California, San Diego
Ivan Lee, Nan Jiang, Taylor Berg-Kirkpatrick
in-context learning;neural architectures
Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability