Salesforce AI Research; University of Michigan; UC Berkeley
Tianyu Guo, Wei Hu, Song Mei, Huan Wang, Caiming Xiong, Silvio Savarese, Yu Bai
in-context learning;transformers;representation learning;learning theory;mechanistic understanding
How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations