Massachusetts Institute of Technology; Microsoft Research NYC
Pratyusha Sharma, Jordan Ash, Dipendra Kumar Misra
Large Language models;Transformers;Low-rank approximation
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction