School of Computer Science, McGill University, Montr´eal, QC H3A 0G4 Canada; Dept. of Mathematics, University of Pennsylvania, Philadelphia, PA 19104 USA; Dept. of Operations Research & Financial Engineering, Princeton University, Princeton, NJ 08544 USA
Boris Hanin, Ryan Jeong, David Rolnick
deep learning theory;random ReLU networks;length distortion;initialization;expressivity
Deep ReLU Networks Preserve Expected Length