{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/16282","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/16282/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/16282/comments","events_url":"https://api.github.com/repos/apache/spark/issues/16282/events","html_url":"https://github.com/apache/spark/pull/16282","id":195648822,"number":16282,"title":"[DO_NOT_MERGE]Try to fix kafka","user":{"login":"zsxwing","id":1000778,"avatar_url":"https://avatars.githubusercontent.com/u/1000778?v=3","gravatar_id":"","url":"https://api.github.com/users/zsxwing","html_url":"https://github.com/zsxwing","followers_url":"https://api.github.com/users/zsxwing/followers","following_url":"https://api.github.com/users/zsxwing/following{/other_user}","gists_url":"https://api.github.com/users/zsxwing/gists{/gist_id}","starred_url":"https://api.github.com/users/zsxwing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zsxwing/subscriptions","organizations_url":"https://api.github.com/users/zsxwing/orgs","repos_url":"https://api.github.com/users/zsxwing/repos","events_url":"https://api.github.com/users/zsxwing/events{/privacy}","received_events_url":"https://api.github.com/users/zsxwing/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":14,"created_at":"2016-12-14T21:20:32Z","updated_at":"2016-12-16T19:27:38Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/16282","html_url":"https://github.com/apache/spark/pull/16282","diff_url":"https://github.com/apache/spark/pull/16282.diff","patch_url":"https://github.com/apache/spark/pull/16282.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nWhen KafkaSource fails on Kafka errors, we should create a new consumer to retry rather than using the existing broken one because it's possible that the broken one will fail again.\r\n\r\nThis PR also assigns a new group id to the new created consumer for a possible race condition:  the broken consumer cannot talk with the Kafka cluster in `close` but the new consumer can talk to Kafka cluster. I'm not sure if this will happen or not. Just for safety to avoid that the Kafka cluster thinks there are two consumers with the same group id in a short time window. (Note: CachedKafkaConsumer doesn't need this fix since `assign` never uses the group id.)\r\n\r\n## How was this patch tested?\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/267675898","html_url":"https://github.com/apache/spark/pull/16282#issuecomment-267675898","issue_url":"https://api.github.com/repos/apache/spark/issues/16282","id":267675898,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-12-16T19:27:38Z","updated_at":"2016-12-16T19:27:38Z","body":"**[Test build #70266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70266/testReport)** for PR 16282 at commit [`0f3a7f9`](https://github.com/apache/spark/commit/0f3a7f9fa1b23bd3901ccbc4fd443bfafa03e71c)."}}
{"actor":{"display_login":"SparkQA"}}