cs.CL cs.AI cs.LG
OLMoE: Open Mixture-of-Experts Language Models
Niklas Muennighoff Luca Soldaini Dirk Groeneveld Kyle Lo Jacob Morrison Sewon Min Weijia Shi Pete Walsh Oyvind Tafjord Nathan Lambert Yuling Gu Shane Arora Akshita Bhagia Dustin Schwenk David Wadden Alexander Wettig Binyuan Hui Tim Dettmers Douwe Kiela Ali Farhadi Noah A. Smith Pang Wei Koh Amanpreet Singh Hannaneh Hajishirzi