{"action":"created","issue":{"url":"https://api.github.com/repos/ray-project/ray/issues/1564","repository_url":"https://api.github.com/repos/ray-project/ray","labels_url":"https://api.github.com/repos/ray-project/ray/issues/1564/labels{/name}","comments_url":"https://api.github.com/repos/ray-project/ray/issues/1564/comments","events_url":"https://api.github.com/repos/ray-project/ray/issues/1564/events","html_url":"https://github.com/ray-project/ray/pull/1564","id":298389797,"number":1564,"title":"Resource capacity-based global scheduler policy","user":{"login":"atumanov","id":1316372,"avatar_url":"https://avatars1.githubusercontent.com/u/1316372?v=4","gravatar_id":"","url":"https://api.github.com/users/atumanov","html_url":"https://github.com/atumanov","followers_url":"https://api.github.com/users/atumanov/followers","following_url":"https://api.github.com/users/atumanov/following{/other_user}","gists_url":"https://api.github.com/users/atumanov/gists{/gist_id}","starred_url":"https://api.github.com/users/atumanov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/atumanov/subscriptions","organizations_url":"https://api.github.com/users/atumanov/orgs","repos_url":"https://api.github.com/users/atumanov/repos","events_url":"https://api.github.com/users/atumanov/events{/privacy}","received_events_url":"https://api.github.com/users/atumanov/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-02-19T20:13:06Z","updated_at":"2018-02-19T21:12:39Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/ray-project/ray/pulls/1564","html_url":"https://github.com/ray-project/ray/pull/1564","diff_url":"https://github.com/ray-project/ray/pull/1564.diff","patch_url":"https://github.com/ray-project/ray/pull/1564.patch"},"body":"<!--\r\nThank you for your contribution!\r\n\r\nPlease review https://github.com/ray-project/ray/blob/master/CONTRIBUTING.rst before opening a pull request.\r\n-->\r\n## Summary of changes\r\n\r\nThis PR updates the global scheduler policy to consider expected resource capacity for scheduled tasks. If no nodes are found, which contain enough expected resource capacity for the scheduled task, the policy falls back to random.\r\n\r\nIn preliminary evaluation (on MacOSX), this PR significantly improves initial load distribution from a single driver for shorter tasks. For example, on 10 simulated local scheduler nodes, 10 cores each, 100 1sec tasks get perfect load distribution after a warmup (which ensures that all workers are up).\r\n\r\n## Related issue number\r\nhttps://github.com/ray-project/ray/issues/1180\r\n\r\n<!-- Are there any issues opened that will be resolved by merging this change? -->\r\n"},"comment":{"url":"https://api.github.com/repos/ray-project/ray/issues/comments/366803845","html_url":"https://github.com/ray-project/ray/pull/1564#issuecomment-366803845","issue_url":"https://api.github.com/repos/ray-project/ray/issues/1564","id":366803845,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars3.githubusercontent.com/u/4031291?v=4","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2018-02-19T21:12:39Z","updated_at":"2018-02-19T21:12:39Z","author_association":"COLLABORATOR","body":"Test PASSed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/3842/\nTest PASSed."}}
{"actor":{"display_login":"AmplabJenkins"}}