University of Calgary; University of Guelph, Vector Institute for AI; Google DeepMind; Massachusetts Institute of Technology, IAIFI
Mike Lasby, Anna Golubeva, Utku Evci, Mihai Nica, Yani Ioannou
Machine Learning;dynamic sparse training;structured sparsity;N:M sparsity;efficient deep learning;RigL;SRigL;constant fan-in;dynamic neuron ablation;neuron ablation;structured and fine-grained sparsity;online inference;accelerating inference
Dynamic Sparse Training with Structured Sparsity