UNC Chapel Hill; Duke University
Yi-Lin Sung, Varun Nair, Colin Raffel
Fisher information;sparse updates;parameter-efficient transfer learning;distributed training;efficient checkpointing
Training Neural Networks with Fixed Sparse Masks