{"action":"created","issue":{"url":"https://api.github.com/repos/ray-project/ray/issues/3324","repository_url":"https://api.github.com/repos/ray-project/ray","labels_url":"https://api.github.com/repos/ray-project/ray/issues/3324/labels{/name}","comments_url":"https://api.github.com/repos/ray-project/ray/issues/3324/comments","events_url":"https://api.github.com/repos/ray-project/ray/issues/3324/events","html_url":"https://github.com/ray-project/ray/pull/3324","id":380946133,"node_id":"MDExOlB1bGxSZXF1ZXN0MjMxMDI4MTk1","number":3324,"title":"Ready queue refactor to make Dispatching tasks more efficient","user":{"login":"pcmoritz","id":113316,"node_id":"MDQ6VXNlcjExMzMxNg==","avatar_url":"https://avatars1.githubusercontent.com/u/113316?v=4","gravatar_id":"","url":"https://api.github.com/users/pcmoritz","html_url":"https://github.com/pcmoritz","followers_url":"https://api.github.com/users/pcmoritz/followers","following_url":"https://api.github.com/users/pcmoritz/following{/other_user}","gists_url":"https://api.github.com/users/pcmoritz/gists{/gist_id}","starred_url":"https://api.github.com/users/pcmoritz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pcmoritz/subscriptions","organizations_url":"https://api.github.com/users/pcmoritz/orgs","repos_url":"https://api.github.com/users/pcmoritz/repos","events_url":"https://api.github.com/users/pcmoritz/events{/privacy}","received_events_url":"https://api.github.com/users/pcmoritz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"stephanie-wang","id":2560516,"node_id":"MDQ6VXNlcjI1NjA1MTY=","avatar_url":"https://avatars2.githubusercontent.com/u/2560516?v=4","gravatar_id":"","url":"https://api.github.com/users/stephanie-wang","html_url":"https://github.com/stephanie-wang","followers_url":"https://api.github.com/users/stephanie-wang/followers","following_url":"https://api.github.com/users/stephanie-wang/following{/other_user}","gists_url":"https://api.github.com/users/stephanie-wang/gists{/gist_id}","starred_url":"https://api.github.com/users/stephanie-wang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stephanie-wang/subscriptions","organizations_url":"https://api.github.com/users/stephanie-wang/orgs","repos_url":"https://api.github.com/users/stephanie-wang/repos","events_url":"https://api.github.com/users/stephanie-wang/events{/privacy}","received_events_url":"https://api.github.com/users/stephanie-wang/received_events","type":"User","site_admin":false},"assignees":[{"login":"stephanie-wang","id":2560516,"node_id":"MDQ6VXNlcjI1NjA1MTY=","avatar_url":"https://avatars2.githubusercontent.com/u/2560516?v=4","gravatar_id":"","url":"https://api.github.com/users/stephanie-wang","html_url":"https://github.com/stephanie-wang","followers_url":"https://api.github.com/users/stephanie-wang/followers","following_url":"https://api.github.com/users/stephanie-wang/following{/other_user}","gists_url":"https://api.github.com/users/stephanie-wang/gists{/gist_id}","starred_url":"https://api.github.com/users/stephanie-wang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stephanie-wang/subscriptions","organizations_url":"https://api.github.com/users/stephanie-wang/orgs","repos_url":"https://api.github.com/users/stephanie-wang/repos","events_url":"https://api.github.com/users/stephanie-wang/events{/privacy}","received_events_url":"https://api.github.com/users/stephanie-wang/received_events","type":"User","site_admin":false}],"milestone":null,"comments":21,"created_at":"2018-11-15T00:23:44Z","updated_at":"2018-11-17T20:08:00Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/ray-project/ray/pulls/3324","html_url":"https://github.com/ray-project/ray/pull/3324","diff_url":"https://github.com/ray-project/ray/pull/3324.diff","patch_url":"https://github.com/ray-project/ray/pull/3324.patch"},"body":"This fixes the same problem as https://github.com/ray-project/ray/pull/3310 but in a slightly different way: Instead of maintaining the minimum resources needed by tasks in the ready queue and skipping going over the tasks there, it keeps an index on which resource shape a task is from, which makes it fast to determine which tasks are of a given resource shape.\r\n\r\nThis PR implements the simplest version of this idea and there is a number of refinements that could be applied (avoiding the task copies, implementing a more clever strategy to avoid head-of-line blocking).\r\n\r\nIt has the advantage over https://github.com/ray-project/ray/pull/3310 int that the datastructure allows O(1) in determining which tasks to dispatch (although it currently is more expensive than that, but cheaper than in the master, and also cheaper than in the other PR; the strategy there would break down if the ready queue contains zero-resource tasks). It can also facilitate smarter head-of-line blocking avoidance in the future. It has the disadvantage that it doesn't preserve approximate FIFO order like the other PR does."},"comment":{"url":"https://api.github.com/repos/ray-project/ray/issues/comments/439644119","html_url":"https://github.com/ray-project/ray/pull/3324#issuecomment-439644119","issue_url":"https://api.github.com/repos/ray-project/ray/issues/3324","id":439644119,"node_id":"MDEyOklzc3VlQ29tbWVudDQzOTY0NDExOQ==","user":{"login":"AmplabJenkins","id":4031291,"node_id":"MDQ6VXNlcjQwMzEyOTE=","avatar_url":"https://avatars3.githubusercontent.com/u/4031291?v=4","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2018-11-17T20:08:00Z","updated_at":"2018-11-17T20:08:00Z","author_association":"COLLABORATOR","body":"Test FAILed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/9412/\nTest FAILed."}}
{"actor":{"display_login":"AmplabJenkins"}}