UNIST (Ulsan National Institute of Science and Technology)
Changhyeon Lee, Seulki Lee
Memory efficient;Activation saving memory;NLP;Transformer
Softmax Output Approximation for Activation Memory-Efficient Training of Attention-based Networks