The University of Texas at Austin
Yeonju Ro, Zhangyang Wang, Vijay Chidambaram, Aditya Akella
Lowering the Pre-training Tax for Gradient-based Subset Training: A Lightweight Distributed Pre-Training Toolkit