{"action":"created","issue":{"url":"https://api.github.com/repos/deeplearning4j/deeplearning4j/issues/2190","repository_url":"https://api.github.com/repos/deeplearning4j/deeplearning4j","labels_url":"https://api.github.com/repos/deeplearning4j/deeplearning4j/issues/2190/labels{/name}","comments_url":"https://api.github.com/repos/deeplearning4j/deeplearning4j/issues/2190/comments","events_url":"https://api.github.com/repos/deeplearning4j/deeplearning4j/issues/2190/events","html_url":"https://github.com/deeplearning4j/deeplearning4j/issues/2190","id":183750918,"number":2190,"title":"Increasing scores while training a deep autoencoder with RBM","user":{"login":"DesmondYuan","id":20073463,"avatar_url":"https://avatars.githubusercontent.com/u/20073463?v=3","gravatar_id":"","url":"https://api.github.com/users/DesmondYuan","html_url":"https://github.com/DesmondYuan","followers_url":"https://api.github.com/users/DesmondYuan/followers","following_url":"https://api.github.com/users/DesmondYuan/following{/other_user}","gists_url":"https://api.github.com/users/DesmondYuan/gists{/gist_id}","starred_url":"https://api.github.com/users/DesmondYuan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/DesmondYuan/subscriptions","organizations_url":"https://api.github.com/users/DesmondYuan/orgs","repos_url":"https://api.github.com/users/DesmondYuan/repos","events_url":"https://api.github.com/users/DesmondYuan/events{/privacy}","received_events_url":"https://api.github.com/users/DesmondYuan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-10-18T17:22:41Z","updated_at":"2016-10-18T17:26:32Z","closed_at":null,"body":"I am training a deep autoencoder 978->500->250->100->30 but it seems quite weird that during the pretraining phase the score (both for RMSE_XENT and MSE )is increasing.  Changing random seeds does not help. Adding some regularization or gradient normalization method does not help that much, only slow down the increase rate. I've tried a batchSize=100 and 1000, does not help...\r\n\r\nA piece of log and the full code can be found here [https://gist.github.com/DesmondYuan/159b8f0064e9375801810d099e1e14e6](url)"},"comment":{"url":"https://api.github.com/repos/deeplearning4j/deeplearning4j/issues/comments/254579228","html_url":"https://github.com/deeplearning4j/deeplearning4j/issues/2190#issuecomment-254579228","issue_url":"https://api.github.com/repos/deeplearning4j/deeplearning4j/issues/2190","id":254579228,"user":{"login":"DesmondYuan","id":20073463,"avatar_url":"https://avatars.githubusercontent.com/u/20073463?v=3","gravatar_id":"","url":"https://api.github.com/users/DesmondYuan","html_url":"https://github.com/DesmondYuan","followers_url":"https://api.github.com/users/DesmondYuan/followers","following_url":"https://api.github.com/users/DesmondYuan/following{/other_user}","gists_url":"https://api.github.com/users/DesmondYuan/gists{/gist_id}","starred_url":"https://api.github.com/users/DesmondYuan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/DesmondYuan/subscriptions","organizations_url":"https://api.github.com/users/DesmondYuan/orgs","repos_url":"https://api.github.com/users/DesmondYuan/repos","events_url":"https://api.github.com/users/DesmondYuan/events{/privacy}","received_events_url":"https://api.github.com/users/DesmondYuan/received_events","type":"User","site_admin":false},"created_at":"2016-10-18T17:26:32Z","updated_at":"2016-10-18T17:26:32Z","body":"changing the LossFunction from XENT to MSE for outputLayer stops the bleeding and the finetune score is falling now. But the remains increasing, though slowly. "}}
{"actor":{"display_login":"DesmondYuan"}}