{"action":"closed","issue":{"url":"https://api.github.com/repos/fchollet/keras/issues/3970","repository_url":"https://api.github.com/repos/fchollet/keras","labels_url":"https://api.github.com/repos/fchollet/keras/issues/3970/labels{/name}","comments_url":"https://api.github.com/repos/fchollet/keras/issues/3970/comments","events_url":"https://api.github.com/repos/fchollet/keras/issues/3970/events","html_url":"https://github.com/fchollet/keras/issues/3970","id":181114655,"number":3970,"title":"Learning Rate and Momentum not being Updated","user":{"login":"jekintrivedi","id":679044,"avatar_url":"https://avatars.githubusercontent.com/u/679044?v=3","gravatar_id":"","url":"https://api.github.com/users/jekintrivedi","html_url":"https://github.com/jekintrivedi","followers_url":"https://api.github.com/users/jekintrivedi/followers","following_url":"https://api.github.com/users/jekintrivedi/following{/other_user}","gists_url":"https://api.github.com/users/jekintrivedi/gists{/gist_id}","starred_url":"https://api.github.com/users/jekintrivedi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jekintrivedi/subscriptions","organizations_url":"https://api.github.com/users/jekintrivedi/orgs","repos_url":"https://api.github.com/users/jekintrivedi/repos","events_url":"https://api.github.com/users/jekintrivedi/events{/privacy}","received_events_url":"https://api.github.com/users/jekintrivedi/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-10-05T10:14:53Z","updated_at":"2016-10-05T11:28:58Z","closed_at":"2016-10-05T11:28:58Z","body":"Hey Guys, \r\n\r\nSo I was testing the callback API on MNIST. I added a custom callback function to print the current Learning Rate and Momentum. However it prints the same initialized value, whereas in SGD with a decay value set, the Learning Rate should decay over epoch. \r\n\r\nPlease find the script here : https://gist.github.com/jekintrivedi/1e38b0f1d1e6c962bfba54febb4575a3\r\n\r\nI have all the libraries updated to the master branch. Can anyone tell me what I am doing wrong here. \r\n\r\nTHEANO_FLAGS=mode=FAST_RUN,device=gpu7,floatX=float32 python m\r\nnist_test.py\r\nUsing Theano backend.\r\nUsing gpu device 7: Tesla K20m (CNMeM is disabled, cuDNN 5005)\r\nX_train shape: (60000, 1, 28, 28)\r\n60000 train samples\r\n10000 test samples\r\nTrain on 60000 samples, validate on 10000 samples\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 1/12\r\n60000/60000 [==============================] - 14s - loss: 0.4964 - acc: 0.8432 - val_loss: 0.1558 - val_acc: 0.9528\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 2/12\r\n60000/60000 [==============================] - 14s - loss: 0.2126 - acc: 0.9354 - val_loss: 0.0845 - val_acc: 0.9727\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 3/12\r\n60000/60000 [==============================] - 14s - loss: 0.1465 - acc: 0.9557 - val_loss: 0.0651 - val_acc: 0.9801\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 4/12\r\n60000/60000 [==============================] - 14s - loss: 0.1187 - acc: 0.9644 - val_loss: 0.0555 - val_acc: 0.9821\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 5/12\r\n60000/60000 [==============================] - 14s - loss: 0.1003 - acc: 0.9694 - val_loss: 0.0484 - val_acc: 0.9843\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 6/12\r\n60000/60000 [==============================] - 14s - loss: 0.0881 - acc: 0.9729 - val_loss: 0.0433 - val_acc: 0.9859\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 7/12\r\n60000/60000 [==============================] - 14s - loss: 0.0769 - acc: 0.9763 - val_loss: 0.0392 - val_acc: 0.9879\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 8/12\r\n60000/60000 [==============================] - 14s - loss: 0.0690 - acc: 0.9782 - val_loss: 0.0383 - val_acc: 0.9868\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 9/12\r\n60000/60000 [==============================] - 14s - loss: 0.0649 - acc: 0.9795 - val_loss: 0.0351 - val_acc: 0.9877\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 10/12\r\n60000/60000 [==============================] - 14s - loss: 0.0614 - acc: 0.9808 - val_loss: 0.0350 - val_acc: 0.9873\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 11/12\r\n60000/60000 [==============================] - 14s - loss: 0.0566 - acc: 0.9827 - val_loss: 0.0329 - val_acc: 0.9890\r\nlr :  0.00999999977648 momentum : 0.899999976158\r\nEpoch 12/12\r\n60000/60000 [==============================] - 14s - loss: 0.0541 - acc: 0.9829 - val_loss: 0.0336 - val_acc: 0.9891\r\n10000/10000 [==============================] - 2s\r\nTest score: 0.0336044333406\r\nTest accuracy: 0.9891\r\n\r\n"}}
{"actor":{"display_login":"jekintrivedi"}}