1School of Informatics, Xiamen University; 3Shanghai Artificial Intelligence Laboratory; 6Tsinghua University; 2This work was done during an internship in MSRA; 7Fudan University; 2This work was done during an internship in MSRA; 4Microsoft Research Asia; 5Microsoft; 1School of Informatics, Xiamen University; 2This work was done during an internship in MSRA; 3Shanghai Artificial Intelligence Laboratory
Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Nan Duan, Weizhu Chen
Text Generation with Diffusion Language Models: A Pre-training Approach with Continuous Paragraph Denoise