University of Massachusetts Lowell
Vladislav Lialin, Sherin Muckatira, Namrata Shivagunde, Anna Rumshisky
language models;pre-training;training efficiency;parameter-efficient fine-tuning;lora
ReLoRA: High-Rank Training Through Low-Rank Updates