Allen Institute for AI; University of Southern California
analysis of language models; probability; surface form competition; multiple-choice tasks; text generation; few-shot prompting
Increasing Probability Mass on Answer Choices Does Not Always Improve Accuracy