Department of Computer Science, Tel Aviv University, Israel; Department of Electrical Engineering, Technion, Israel
Itai Kreisler, Mor Shpigel Nacson, Daniel Soudry, Yair Carmon
Gradient Descent Monotonically Decreases the Sharpness of Gradient Flow Solutions in Scalar Networks and Beyond