Seoul National University, Seoul, Korea
Sunghyeon Woo, SunWoo Lee, Dongsuk Jeon
Memory efficient training;Activation-compressed training;Average Quantization;NLP;Transformer
ALAM: Averaged Low-Precision Activation for Memory-Efficient Training of Transformer Models