Sorbonne Université, CNRS, ISIR, 75005 Paris, France; AgroParisTech, UMR MIA-PS, 91120 Palaiseau, France
Deep learning;parameter efficient fine-tuning;prefix-tuning;subspace learning;natural language processing
Improving generalization in large langue model by learning prefix subspaces