Department of Electronic Engineering, Tsinghua University, Beijing, China; Frontis.AI, Beijing, China; Department of Electronic Engineering, Tsinghua University, Beijing, China; Department of Electronic Engineering, Tsinghua University, Beijing, China; Frontis.AI, Beijing, China; School of Astronautics, Harbin Institute of Technology, Harbin, China
large language models;transfer learning;representation similarity;model privacy
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model