AIRI, Moscow, Russia; Center for Artificial Intelligence Technology, Skolkovo Institute of Science and Technology, Moscow, Russia
Georgii Novikov, Daniel Bershatsky, Julia Gusak, Alex Shonenkov, Denis Dimitrov, Ivan Oseledets
Few-bit Backward: Quantized Gradients of Activation Functions for Memory Footprint Reduction