Mila, Université de Montréal; University of Tübingen; Max Planck Institute for Intelligent Systems - Tübingen; ETH Zürich; University of Cambridge
Weiyang Liu, Zeju Qiu, Yao Feng, Yuliang Xiu, Yuxuan Xue, Longhui Yu, Haiwen Feng, Zhen Liu, Juyeon Heo, Songyou Peng, Yandong Wen, Michael J Black, Adrian Weller, Bernhard Schoelkopf
Parameter-efficient finetuning;orthogonal;Butterfly matrix
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization