MediaTek Research, Cambourne Business Park, CB23 6DW, UK; Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, UK
Jezabel R. Garcia, Federica Freddi, Stathi Fotiadis, Maolin Li, Sattar Vakili, Alberto Bernacchia, Guillaume Hennequin
Second-order optimization;Natural Gradient;Deep Learning;Meta-learning;Fisher information;Legendre-Fenchel duality
Fisher-Legendre (FishLeg) optimization of deep neural networks