Under double-blind review
Language model pretraining;multimodal learning;code understanding and generation
CodeT5Mix: A Pretrained Mixture of Encoder-decoder Transformers for Code Understanding and Generation