University of California, Berkeley / ICSI; University of California, Berkeley; University of California, Berkeley / ICSI / LBNL
Sehoon Kim, Karttikeya Mangalam, Suhong Moon, Jitendra Malik, Michael Mahoney, Amir Gholami, Kurt Keutzer
Transformer;efficient inference;efficient model;decoding
Speculative Decoding with Big Little Decoder