Dead Point;Dead Unit;Model Scaling;Separation Constraints;Dying ReLU;Constant Width;Deep Neural Networks;Backpropagation
Superseding Model Scaling by Penalizing Dead Units and Points with Separation Constraints