AWS AI; KAIST AI
Efficient Decoding of Language Model;Early-Exiting Framework;Parallel Decoding;Adaptive Confidence Estimation
Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding