cs.LG cs.AI
HELENE: Hessian Layer-wise Clipping and Gradient Annealing for Accelerating Fine-tuning LLM with Zeroth-order Optimization
Huaqin Zhao Jiaxi Li Yi Pan Shizhe Liang Xiaofeng Yang Wei Liu Xiang Li Fei Dou Tianming Liu Jin Lu