Google Research, Brain Team
Niru Maheswaranathan, David Sussillo, Luke Metz, Ruoxi Sun, Jascha Sohl-Dickstein
optimization;learned optimizers;reverse engineering;RNNs
Reverse engineering learned optimizers reveals known and novel mechanisms