Carnegie Mellon University, Determined AI; Carnegie Mellon University; ENS PSL University
Lucio Dery, Paul Michel, Ameet Talwalkar, Graham Neubig
pre-training;multitask learning;meta-learning;deeplearning;end-task aware training;NLP
Should We Be Pre-training? An Argument for End-task Aware Training as an Alternative