Petuum Inc.; Carnegie Mellon University; University of California, Berkeley; Mohamed Bin Zayed University of Artificial Intelligence
Dacheng Li, Hongyi Wang, Eric Xing, Hao Zhang
Machine Learning Systems;Model Parallelism;Automation;Heterogeneity
AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness