School of Computer Science, McGill University, Montreal, Canada; Mila – Quebec AI Institute, Montreal, Canada; Dept. of Operations Research & Financial Engineering, Princeton University, Princeton, USA
Gaurav Iyer, Boris Hanin, David Rolnick
Maximal Initial Learning Rates in Deep ReLU Networks