{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7786","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/7786/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7786/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7786/events","html_url":"https://github.com/apache/spark/pull/7786","id":98100693,"number":7786,"title":"[SPARK-9468][Yarn][Core] Avoid scheduling tasks on preemption executors","user":{"login":"jerryshao","id":850797,"avatar_url":"https://avatars.githubusercontent.com/u/850797?v=3","gravatar_id":"","url":"https://api.github.com/users/jerryshao","html_url":"https://github.com/jerryshao","followers_url":"https://api.github.com/users/jerryshao/followers","following_url":"https://api.github.com/users/jerryshao/following{/other_user}","gists_url":"https://api.github.com/users/jerryshao/gists{/gist_id}","starred_url":"https://api.github.com/users/jerryshao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jerryshao/subscriptions","organizations_url":"https://api.github.com/users/jerryshao/orgs","repos_url":"https://api.github.com/users/jerryshao/repos","events_url":"https://api.github.com/users/jerryshao/events{/privacy}","received_events_url":"https://api.github.com/users/jerryshao/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":19,"created_at":"2015-07-30T07:11:12Z","updated_at":"2016-06-09T21:23:10Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7786","html_url":"https://github.com/apache/spark/pull/7786","diff_url":"https://github.com/apache/spark/pull/7786.diff","patch_url":"https://github.com/apache/spark/pull/7786.patch"},"body":"For Spark running on Yarn, if preemption is enabled by Yarn, containers will be preempted by Yarn, this will be notified to AM ahead of time. Spark itself should be aware of this preemption information and avoid scheduling tasks on these executors."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/225031069","html_url":"https://github.com/apache/spark/pull/7786#issuecomment-225031069","issue_url":"https://api.github.com/repos/apache/spark/issues/7786","id":225031069,"user":{"login":"vanzin","id":1694083,"avatar_url":"https://avatars.githubusercontent.com/u/1694083?v=3","gravatar_id":"","url":"https://api.github.com/users/vanzin","html_url":"https://github.com/vanzin","followers_url":"https://api.github.com/users/vanzin/followers","following_url":"https://api.github.com/users/vanzin/following{/other_user}","gists_url":"https://api.github.com/users/vanzin/gists{/gist_id}","starred_url":"https://api.github.com/users/vanzin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vanzin/subscriptions","organizations_url":"https://api.github.com/users/vanzin/orgs","repos_url":"https://api.github.com/users/vanzin/repos","events_url":"https://api.github.com/users/vanzin/events{/privacy}","received_events_url":"https://api.github.com/users/vanzin/received_events","type":"User","site_admin":false},"created_at":"2016-06-09T21:23:10Z","updated_at":"2016-06-09T21:23:10Z","body":"@steveloughran \r\n\r\n> I suspect that if you get told you are being pre-empted, you aren't likely to get containers elsewhere\r\n\r\nThat's very possible. But I'm just trying to point out that the current change doesn't really make things better. Without killing the executor, you'll still be holding on to resources, except now you wouldn't be using them. So might as well keep using them for as long as you can, or give them back as soon as possible (i.e. as soon as the executor becomes idle)."}}
{"actor":{"display_login":"vanzin"}}