Lawrence Livermore National Laboratory; Michigan State University; UC Santa Barbara
AOCHUAN CHEN, Yimeng Zhang, Jinghan Jia, James Diffenderfer, Konstantinos Parasyris, Jiancheng Liu, Yihua Zhang, Zheng Zhang, Bhavya Kailkhura, Sijia Liu
gradient-free learning;zeroth-order optimization;gradient sparsity
DeepZero: Scaling Up Zeroth-Order Optimization for Deep Model Training