title: Changing optimizer in keras during training
body: <p>I am developing a model using <code>nadam</code> optimizer. I was wondering if there is a way to switch to <code>sgd</code> during training if validation loss does not reduce for two epochs.</p>