Department of Computer Science, ETH Zurich, Zurich, Switzerland; Google Research
Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, João Sacramento, Alexander Mordvintsev, Andrey Zhmoginov, Max Vladymyrov
Transformers Learn In-Context by Gradient Descent