ADOPT: Modified Adam Can Converge with Any β_2 with the Optimal Rate
Shohei Taniguchi Keno Harada Gouki Minegishi Yuta Oshima Seong Cheol Jeong Go Nagahara Tomoshi Iiyama Masahiro Suzuki Yusuke Iwasawa Yutaka Matsuo