BK21 FOUR R&E Center for Artificial Intelligence, Korea University, Seoul, South Korea; Department of Artificial Intelligence, Korea University, Seoul, South Korea; Department of Computer Science and Engineering, Korea University, Seoul, South Korea
transformer;language models;token routing;token pruning;input length reduction
Leap-of-Thought: Accelerating Transformers via Dynamic Token Routing