Tübingen AI Center & University of Tübingen; Google DeepMind; Tübingen AI Center & University of Tübingen, Helmholtz Munich, Technical University of Munich
Karsten Roth, Lukas Thede, A. Sophia Koepke, Oriol Vinyals, Olivier Henaff, Zeynep Akata
transfer learning;pretraining;weak-to-strong transfer;continual learning
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model