Dept. of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign; IBM T.J. Watson Research Center
Charbel Sakr, Naigang Wang, Chia-Yu Chen, Jungwook Choi, Ankur Agrawal, Naresh Shanbhag, Kailash Gopalakrishnan
reduced precision floating-point;partial sum accumulation bit-width;deep learning;training
Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks