Case Western Reserve University; Texas A&M University; Rice University; Stevens Institute of Technology
Zirui Liu, Guanchu Wang, Shaochen (Henry) Zhong, Zhaozhuo Xu, Daochen Zha, Ruixiang (Ryan) Tang, Zhimeng (Stephen) Jiang, Kaixiong Zhou, Vipin Chaudhary, Shuai Xu, Xia Hu
memory-efficient tuning;language model;transformers
Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model