cs.CL cs.AI cs.DC cs.LG
TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
Wanchao Liang Tianyu Liu Less Wright Will Constable Andrew Gu Chien-Chin Huang Iris Zhang Wei Feng Howard Huang Junjie Wang Sanket Purandare Gokul Nadathur Stratos Idreos