Purdue University, West Lafayette, IN, USA; Google Research, New York, NY, USA; Georgia Institute of Technology, Atlanta, GA, USA
language model inference;efficiency
HadSkip: Homotopic and Adaptive Layer Skipping of Pre-trained Language Models for Efficient Inference