Hebrew University, Google Research; University of Washington; Allen Institute for AI, University of Washington, LAION; UCLA; Allen Institute for AI; Stanford; UCSB
Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt
Vision-language models;Instruction-following;Benchmark;Multimodal chatbots;ELO rating system;Automatic evaluation metric;Dataset collection
VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models