Microsoft Semantic Machines; Scaled Cognition
Subhro Roy, Samuel Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Benjamin Van Durme
Syntactic parsing;semantic parsing;benchmark;constrained decoding;GPT-3
BenchCLAMP: A Benchmark for Evaluating Language Models on Syntactic and Semantic Parsing