Accelerating Large Language Model Training with Hybrid GPU-based Compression
Lang Xu Quentin Anthony Qinghua Zhou Nawras Alnaasan Radha R. Gulhane Aamir Shafi Hari Subramoni Dhabaleswar K. Panda










Accelerating Large Language Model Training with Hybrid GPU-based Compression





    
Lang Xu
The Ohio State University 

Columbus, Ohio 

xu.3304@osu.edu
Quentin Anthony
The Ohio State University 

Columbus, Ohio 

anthony.301@osu.edu
Qinghua Zhou
The Ohio State University 

Columbus, Ohio 

zhou.2595@osu.edu
Nawras Alnaasan
The Ohio State University 

Columbus, Ohio 

alnaasan.1@osu.edu
Radha Gulhane
The Ohio State University 

Columbus, Ohio 

gulhane.2@osu.edu
Aamir Shafi
The Ohio State University 

Columbus, Ohio 

shafi.16@osu.edu
Hari Subramoni
The Ohio State University 

Columbus, Ohio 

subramoni.1@osu.edu
Dhabaleswar K. (DK) Panda
The Ohio State University 

Columbus, Ohio 

panda.2@osu.edu

     
=====================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================














IEEEtran

