Google Brain
Basil Mustafa, Carlos Riquelme, Joan Puigcerver, Rodolphe Jenatton, Neil Houlsby
machine learning;computer vision;natural language processing;multimodal;mixture of experts;conditional computation;sparse computation;contrastive learning;zeroshot classification
Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts