Google Research, New York
Neha Gupta, Harikrishna Narasimhan, Wittawat Jitkrittum, Ankit Singh Rawat, Aditya Krishna Menon, Sanjiv Kumar
Cascades;Efficient Inference;Language Models
Language Model Cascades: Token-Level Uncertainty And Beyond