AWS AI Labs
Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, Xiaopeng Li, YUCHEN TIAN, Ming Tan, Wasi Ahmad, Shiqi Wang, Qing Sun, Mingyue Shang, Sujan Kumar Gonugondla, Hantian Ding, Varun Kumar, Nathan Fulton, Arash Farahani, Siddhartha Jain, Robert Giaquinto, Haifeng Qian, Murali Krishna Ramanathan, Ramesh Nallapati, Baishakhi Ray, Parminder Bhatia, Sudipta Sengupta, Dan Roth, Bing Xiang
code generation;execution-based evaluation;test-based evaluation;language models;multi-lingual code generation benchmark;code insertion;code summarization;robustness for code;code translation;zero-shot code translation;multi-lingual;mono-lingual;language models.
Multi-lingual Evaluation of Code Generation Models