Media Analytics and Computing Laboratory, Department of Artificial Intelligence, School of Informatics, Xiamen University, China; JD Explore Academy, Beijing, China; The University of Sydney, Australia; JD Explore Academy, Beijing, China
Peng Mi, Li Shen, Tianhe Ren, Yiyi Zhou, Xiaoshuai Sun, Rongrong Ji, Dacheng Tao
Sharpness-Aware Minimization;Fisher information;Dynamic sparse training
Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach