Adam;adaptive method;critical batch size;hyperparameters;learning rate;nonconvex optimization;stochastic first-order oracle complexity
Critical Batch Size Minimizes Stochastic First-Order Oracle Complexity of Deep Learning Optimizer using Hyperparameters Close to One