Dept. of Comp. Sci. and Tech., Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint ML Center, Tsinghua University
Bingrui Li, Jianfei Chen, Jun Zhu
memory efficiency;optimizer;Adam;quantization
Memory Efficient Optimizers with 4-bit States