Cohere For AI; Cohere
Ted Zadouri, Ahmet Üstün, Arash Ahmadian, Beyza Ermis, Acyr Locatelli, Sara Hooker
Mixture of Experts;Parameter-Efficient Fine-Tuning
Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning