{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/11996","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/11996/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/11996/comments","events_url":"https://api.github.com/repos/apache/spark/issues/11996/events","html_url":"https://github.com/apache/spark/pull/11996","id":143935484,"number":11996,"title":"[SPARK-10530] [CORE] Kill other task attempts when one taskattempt belonging the same task is succeeded in speculation","user":{"login":"devaraj-kavali","id":3174804,"avatar_url":"https://avatars.githubusercontent.com/u/3174804?v=3","gravatar_id":"","url":"https://api.github.com/users/devaraj-kavali","html_url":"https://github.com/devaraj-kavali","followers_url":"https://api.github.com/users/devaraj-kavali/followers","following_url":"https://api.github.com/users/devaraj-kavali/following{/other_user}","gists_url":"https://api.github.com/users/devaraj-kavali/gists{/gist_id}","starred_url":"https://api.github.com/users/devaraj-kavali/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/devaraj-kavali/subscriptions","organizations_url":"https://api.github.com/users/devaraj-kavali/orgs","repos_url":"https://api.github.com/users/devaraj-kavali/repos","events_url":"https://api.github.com/users/devaraj-kavali/events{/privacy}","received_events_url":"https://api.github.com/users/devaraj-kavali/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":15,"created_at":"2016-03-28T09:20:15Z","updated_at":"2016-05-18T18:22:02Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/11996","html_url":"https://github.com/apache/spark/pull/11996","diff_url":"https://github.com/apache/spark/pull/11996.diff","patch_url":"https://github.com/apache/spark/pull/11996.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nWith this patch, TaskSetManager kills other running attempts when any one of the attempt succeeds for the same task. Also killed tasks will not be considered as failed tasks and they get listed separately in the UI and also shows the task state as KILLED instead of FAILED.\r\n\r\n\r\n## How was this patch tested?\r\n\r\ncore\\src\\test\\scala\\org\\apache\\spark\\ui\\jobs\\JobProgressListenerSuite.scala\r\ncore\\src\\test\\scala\\org\\apache\\spark\\util\\JsonProtocolSuite.scala\r\n\r\n\r\nI have verified this patch manually by enabling spark.speculation as true, when any attempt gets succeeded then other running attempts are getting killed for the same task and other pending tasks are getting assigned in those. And also when any attempt gets killed then they are considered as KILLED tasks and not considered as FAILED tasks. Please find the attached screen shots for the reference.\r\n\r\n![stage-tasks-table](https://cloud.githubusercontent.com/assets/3174804/14075132/394c6a12-f4f4-11e5-8638-20ff7b8cc9bc.png)\r\n![stages-table](https://cloud.githubusercontent.com/assets/3174804/14075134/3b60f412-f4f4-11e5-9ea6-dd0dcc86eb03.png)\r\n\r\n\r\nRef : https://github.com/apache/spark/pull/11916"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/220114675","html_url":"https://github.com/apache/spark/pull/11996#issuecomment-220114675","issue_url":"https://api.github.com/repos/apache/spark/issues/11996","id":220114675,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2016-05-18T18:22:02Z","updated_at":"2016-05-18T18:22:02Z","body":"Test PASSed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/58791/\nTest PASSed."}}