Meta AI; Reality Labs, Meta Inc.; Peking University
Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, Meng Li, Raghuraman Krishnamoorthi, Yashar Mehdad
Natural language processing;BERT;Transformers;Compression;Binary neural networks
BiT: Robustly Binarized Multi-distilled Transformer