{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/20781","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/20781/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/20781/comments","events_url":"https://api.github.com/repos/apache/spark/issues/20781/events","html_url":"https://github.com/apache/spark/pull/20781","id":303732656,"number":20781,"title":"[SPARK-23637][YARN]Yarn might allocate more resource if a same executor is killed multiple times.","user":{"login":"jinxing64","id":4058918,"avatar_url":"https://avatars0.githubusercontent.com/u/4058918?v=4","gravatar_id":"","url":"https://api.github.com/users/jinxing64","html_url":"https://github.com/jinxing64","followers_url":"https://api.github.com/users/jinxing64/followers","following_url":"https://api.github.com/users/jinxing64/following{/other_user}","gists_url":"https://api.github.com/users/jinxing64/gists{/gist_id}","starred_url":"https://api.github.com/users/jinxing64/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jinxing64/subscriptions","organizations_url":"https://api.github.com/users/jinxing64/orgs","repos_url":"https://api.github.com/users/jinxing64/repos","events_url":"https://api.github.com/users/jinxing64/events{/privacy}","received_events_url":"https://api.github.com/users/jinxing64/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-03-09T05:55:08Z","updated_at":"2018-03-09T08:05:12Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/20781","html_url":"https://github.com/apache/spark/pull/20781","diff_url":"https://github.com/apache/spark/pull/20781.diff","patch_url":"https://github.com/apache/spark/pull/20781.patch"},"body":"## What changes were proposed in this pull request?\r\n`YarnAllocator` uses `numExecutorsRunning` to track the number of running executor. `numExecutorsRunning` is used to check if there're executors missing and need to allocate more.\r\n\r\n In current code, `numExecutorsRunning` can be negative when driver asks to kill a same idle executor multiple times.\r\n\r\n\r\n## How was this patch tested?\r\nUT added"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/371741707","html_url":"https://github.com/apache/spark/pull/20781#issuecomment-371741707","issue_url":"https://api.github.com/repos/apache/spark/issues/20781","id":371741707,"user":{"login":"jerryshao","id":850797,"avatar_url":"https://avatars2.githubusercontent.com/u/850797?v=4","gravatar_id":"","url":"https://api.github.com/users/jerryshao","html_url":"https://github.com/jerryshao","followers_url":"https://api.github.com/users/jerryshao/followers","following_url":"https://api.github.com/users/jerryshao/following{/other_user}","gists_url":"https://api.github.com/users/jerryshao/gists{/gist_id}","starred_url":"https://api.github.com/users/jerryshao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jerryshao/subscriptions","organizations_url":"https://api.github.com/users/jerryshao/orgs","repos_url":"https://api.github.com/users/jerryshao/repos","events_url":"https://api.github.com/users/jerryshao/events{/privacy}","received_events_url":"https://api.github.com/users/jerryshao/received_events","type":"User","site_admin":false},"created_at":"2018-03-09T08:05:12Z","updated_at":"2018-03-09T08:05:12Z","author_association":"CONTRIBUTOR","body":"This basically means that drive send multiple same kill requests to AM, right? I'm wondering how this would happen, shall we also guarantee this in the driver side?"}}
{"actor":{"display_login":"jerryshao"}}