Stanford University
Allan Raventós, Mansheej Paul, Feng Chen, Surya Ganguli
in-context learning;Bayesian inference;transformers;task diversity;emergence
Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression