MIT; Harvard University; Google Research; MIT CSAIL; Google DeepMind
Tian Jin, Nolan Clement, Xin Dong, Vaishnavh Nagarajan, Michael Carbin, Jonathan Ragan-Kelley, Gintare Karolina Dziugaite
large language model;scaling;in-context learning;pruning
The Cost of Scaling Down Large Language Models: Reducing Model Size Affects Memory before In-context Learning