{"action":"created","issue":{"url":"https://api.github.com/repos/Kaixhin/Atari/issues/1","repository_url":"https://api.github.com/repos/Kaixhin/Atari","labels_url":"https://api.github.com/repos/Kaixhin/Atari/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/Kaixhin/Atari/issues/1/comments","events_url":"https://api.github.com/repos/Kaixhin/Atari/issues/1/events","html_url":"https://github.com/Kaixhin/Atari/issues/1","id":128156455,"number":1,"title":"Implement rank-based prioritised experience replay","user":{"login":"Kaixhin","id":991891,"avatar_url":"https://avatars.githubusercontent.com/u/991891?v=3","gravatar_id":"","url":"https://api.github.com/users/Kaixhin","html_url":"https://github.com/Kaixhin","followers_url":"https://api.github.com/users/Kaixhin/followers","following_url":"https://api.github.com/users/Kaixhin/following{/other_user}","gists_url":"https://api.github.com/users/Kaixhin/gists{/gist_id}","starred_url":"https://api.github.com/users/Kaixhin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Kaixhin/subscriptions","organizations_url":"https://api.github.com/users/Kaixhin/orgs","repos_url":"https://api.github.com/users/Kaixhin/repos","events_url":"https://api.github.com/users/Kaixhin/events{/privacy}","received_events_url":"https://api.github.com/users/Kaixhin/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/Kaixhin/Atari/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/Kaixhin/Atari/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/Kaixhin/Atari/labels/help%20wanted","name":"help wanted","color":"159818"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":29,"created_at":"2016-01-22T13:25:14Z","updated_at":"2016-05-10T09:11:14Z","closed_at":null,"body":"Requires a \"sum tree\" binary heap for efficient execution."},"comment":{"url":"https://api.github.com/repos/Kaixhin/Atari/issues/comments/218101717","html_url":"https://github.com/Kaixhin/Atari/issues/1#issuecomment-218101717","issue_url":"https://api.github.com/repos/Kaixhin/Atari/issues/1","id":218101717,"user":{"login":"avasilkov","id":4893800,"avatar_url":"https://avatars.githubusercontent.com/u/4893800?v=3","gravatar_id":"","url":"https://api.github.com/users/avasilkov","html_url":"https://github.com/avasilkov","followers_url":"https://api.github.com/users/avasilkov/followers","following_url":"https://api.github.com/users/avasilkov/following{/other_user}","gists_url":"https://api.github.com/users/avasilkov/gists{/gist_id}","starred_url":"https://api.github.com/users/avasilkov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/avasilkov/subscriptions","organizations_url":"https://api.github.com/users/avasilkov/orgs","repos_url":"https://api.github.com/users/avasilkov/repos","events_url":"https://api.github.com/users/avasilkov/events{/privacy}","received_events_url":"https://api.github.com/users/avasilkov/received_events","type":"User","site_admin":false},"created_at":"2016-05-10T09:11:14Z","updated_at":"2016-05-10T09:11:14Z","body":"Thank you, @Kaixhin ! I guess I will go and try FIFO order for removing. Maybe because of my way of removing elements I have stale transitions that only do harm. And thanks for the suggestion about not annealing beta parameter."}}