Cooperative Medianet Innovation Center, Shanghai Jiao Tong University; Shanghai Artificial Intelligence Laboratory; Cooperative Medianet Innovation Center, Shanghai Jiao Tong University; Fudan University
non-autoregressive transformers;self-improvement;distillation
Self-Improvement of Non-autoregressive Model via Sequence-Level Distillation