title: Visualizing the loss landscape in deep NN to compare optimization methods
body: <p>I'm comparing 2 optimization algorithms for deep neural nets through visualizing the loss landscape. The visualization method is described <a href="https://arxiv.org/abs/1712.09913" rel="nofollow noreferrer">here</a>.</p>
  <p>Besides the qualitative observation that how trajectory moves w.r.t. the loss level-sets, are there any quantitive measures to compare the two methods?</p>
  <p><a href="https://i.stack.imgur.com/28MPDm.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/28MPDm.png" alt="enter image description here" /></a>
  <a href="https://i.stack.imgur.com/4rbdzm.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/4rbdzm.png" alt="enter image description here" /></a></p>