Convergence guarantees for RMSProp and ADAM in non-convex optimization and their comparison to Nesterov acceleration on autoencoders
Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent