Google DeepMind and Columbia University; Google DeepMind; Google Research
Deepali Jain, Krzysztof M Choromanski, Kumar Avinava Dubey, Sumeet Singh, Vikas Sindhwani, Tingnan Zhang, Jie Tan
learnable optimizers;Transformers;efficient attention;spatio-temporal attention
Mnemosyne: Learning to Train Transformers with Transformers