{"action":"created","issue":{"url":"https://api.github.com/repos/songrotek/DRL-FlappyBird/issues/1","repository_url":"https://api.github.com/repos/songrotek/DRL-FlappyBird","labels_url":"https://api.github.com/repos/songrotek/DRL-FlappyBird/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/songrotek/DRL-FlappyBird/issues/1/comments","events_url":"https://api.github.com/repos/songrotek/DRL-FlappyBird/issues/1/events","html_url":"https://github.com/songrotek/DRL-FlappyBird/issues/1","id":148652390,"number":1,"title":"New observation update problem","user":{"login":"yenchenlin1994","id":7057863,"avatar_url":"https://avatars.githubusercontent.com/u/7057863?v=3","gravatar_id":"","url":"https://api.github.com/users/yenchenlin1994","html_url":"https://github.com/yenchenlin1994","followers_url":"https://api.github.com/users/yenchenlin1994/followers","following_url":"https://api.github.com/users/yenchenlin1994/following{/other_user}","gists_url":"https://api.github.com/users/yenchenlin1994/gists{/gist_id}","starred_url":"https://api.github.com/users/yenchenlin1994/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yenchenlin1994/subscriptions","organizations_url":"https://api.github.com/users/yenchenlin1994/orgs","repos_url":"https://api.github.com/users/yenchenlin1994/repos","events_url":"https://api.github.com/users/yenchenlin1994/events{/privacy}","received_events_url":"https://api.github.com/users/yenchenlin1994/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-04-15T12:52:53Z","updated_at":"2016-04-16T01:33:04Z","closed_at":null,"body":"Hello @songrotek , code [here](https://github.com/songrotek/DRL-FlappyBird/blob/master/BrainDQN_Nature.py#L137) seems to keep the oldest 3 frames forever, which means the algorithm is not using the newest 4 frames to represent state.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/songrotek/DRL-FlappyBird/issues/comments/210705667","html_url":"https://github.com/songrotek/DRL-FlappyBird/issues/1#issuecomment-210705667","issue_url":"https://api.github.com/repos/songrotek/DRL-FlappyBird/issues/1","id":210705667,"user":{"login":"songrotek","id":3880963,"avatar_url":"https://avatars.githubusercontent.com/u/3880963?v=3","gravatar_id":"","url":"https://api.github.com/users/songrotek","html_url":"https://github.com/songrotek","followers_url":"https://api.github.com/users/songrotek/followers","following_url":"https://api.github.com/users/songrotek/following{/other_user}","gists_url":"https://api.github.com/users/songrotek/gists{/gist_id}","starred_url":"https://api.github.com/users/songrotek/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/songrotek/subscriptions","organizations_url":"https://api.github.com/users/songrotek/orgs","repos_url":"https://api.github.com/users/songrotek/repos","events_url":"https://api.github.com/users/songrotek/events{/privacy}","received_events_url":"https://api.github.com/users/songrotek/received_events","type":"User","site_admin":false},"created_at":"2016-04-16T01:33:04Z","updated_at":"2016-04-16T01:33:04Z","body":"it seems that \r\n`newState = np.append(self.currentState[:,:,1:],nextObservation,axis = 2)` \r\nis better"}}