{"action":"created","issue":{"url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs/issues/1","repository_url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs","labels_url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs/issues/1/comments","events_url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs/issues/1/events","html_url":"https://github.com/yanpanlau/DDPG-Keras-Torcs/issues/1","id":183309599,"number":1,"title":"Training does not learn anything","user":{"login":"sahiliitm","id":5723372,"avatar_url":"https://avatars.githubusercontent.com/u/5723372?v=3","gravatar_id":"","url":"https://api.github.com/users/sahiliitm","html_url":"https://github.com/sahiliitm","followers_url":"https://api.github.com/users/sahiliitm/followers","following_url":"https://api.github.com/users/sahiliitm/following{/other_user}","gists_url":"https://api.github.com/users/sahiliitm/gists{/gist_id}","starred_url":"https://api.github.com/users/sahiliitm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sahiliitm/subscriptions","organizations_url":"https://api.github.com/users/sahiliitm/orgs","repos_url":"https://api.github.com/users/sahiliitm/repos","events_url":"https://api.github.com/users/sahiliitm/events{/privacy}","received_events_url":"https://api.github.com/users/sahiliitm/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-10-17T01:57:49Z","updated_at":"2016-10-17T02:51:02Z","closed_at":null,"body":"Hi,\r\n\r\nAfter training for about 75000 steps, only 8 episodes have passed and the agent has not learnt anything useful. My question is: does the current `ddpg.py` file have the correct hyper-parameters? The saved `.h5` model in this repo does indeed work well, so I was wondering if it was trained using the same hyper-parameters. \r\n\r\nA part of the output:\r\n\r\n```\r\n('Episode', 8, 'Step', 76169, 'Action', array([[ 0.65779338,  0.13147314,  0.72898711]]), 'Reward', -0.11919999787368826, 'Loss', 0.76000809669494629)\r\n('Episode', 8, 'Step', 76170, 'Action', array([[ 0.72513585,  0.05947028,  0.72827826]]), 'Reward', -0.23072561310301709, 'Loss', 0.12980197370052338)\r\n('Episode', 8, 'Step', 76171, 'Action', array([[ 0.71874098,  0.12731329,  0.73625542]]), 'Reward', 0.012969128165889354, 'Loss', 0.46787607669830322)\r\n('Episode', 8, 'Step', 76172, 'Action', array([[ 0.6552096 ,  0.11575382,  0.72765934]]), 'Reward', -0.0072166273178536217, 'Loss', 0.                9427763819694519)\r\n```\r\n\r\nHow the TORCS screen looks right now:\r\n![selection_137](https://cloud.githubusercontent.com/assets/5723372/19423138/0c903d82-943b-11e6-8934-4cc2fa38bcd5.png)\r\n\r\nIn short, the training does not seem to proceed smoothly. Can you please verify if the current version of the code trains well? If not, I suspect the hyper-parameters may have changed between the model which worked well and this version of the code.\r\n\r\nThanks,"},"comment":{"url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs/issues/comments/254100982","html_url":"https://github.com/yanpanlau/DDPG-Keras-Torcs/issues/1#issuecomment-254100982","issue_url":"https://api.github.com/repos/yanpanlau/DDPG-Keras-Torcs/issues/1","id":254100982,"user":{"login":"sahiliitm","id":5723372,"avatar_url":"https://avatars.githubusercontent.com/u/5723372?v=3","gravatar_id":"","url":"https://api.github.com/users/sahiliitm","html_url":"https://github.com/sahiliitm","followers_url":"https://api.github.com/users/sahiliitm/followers","following_url":"https://api.github.com/users/sahiliitm/following{/other_user}","gists_url":"https://api.github.com/users/sahiliitm/gists{/gist_id}","starred_url":"https://api.github.com/users/sahiliitm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sahiliitm/subscriptions","organizations_url":"https://api.github.com/users/sahiliitm/orgs","repos_url":"https://api.github.com/users/sahiliitm/repos","events_url":"https://api.github.com/users/sahiliitm/events{/privacy}","received_events_url":"https://api.github.com/users/sahiliitm/received_events","type":"User","site_admin":false},"created_at":"2016-10-17T02:51:02Z","updated_at":"2016-10-17T02:51:02Z","body":"Oh, thanks. Which tracks are simple? And which ones are more complicated? I usually run torcs in practice mode. Is that one of the simpler ones?"}}
{"actor":{"display_login":"sahiliitm"}}