Language Technologies Institute, Carnegie Mellon University, Allen Institute for Artificial Intelligence; FAIR; Language Technologies Institute, Carnegie Mellon University
efficiency;latency;inference
The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment