University of California San Diego; Microsoft Research; Microsoft
Mojan Javaheripi, Gustavo de Rosa, Subhabrata Mukherjee, Shital Shah, Tomasz Religa, Caio Cesar Teodoro Mendes, Sebastien Bubeck, Farinaz Koushanfar, Debadeepta Dey
Neural Architecture Search;AutoML;Transformers
LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models