{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/21445","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/21445/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/21445/comments","events_url":"https://api.github.com/repos/apache/spark/issues/21445/events","html_url":"https://github.com/apache/spark/pull/21445","id":327065277,"number":21445,"title":"[SPARK-24404][SS] Increase currentEpoch when meet a EpochMarker in Co…","user":{"login":"LiangchangZ","id":34741089,"avatar_url":"https://avatars1.githubusercontent.com/u/34741089?v=4","gravatar_id":"","url":"https://api.github.com/users/LiangchangZ","html_url":"https://github.com/LiangchangZ","followers_url":"https://api.github.com/users/LiangchangZ/followers","following_url":"https://api.github.com/users/LiangchangZ/following{/other_user}","gists_url":"https://api.github.com/users/LiangchangZ/gists{/gist_id}","starred_url":"https://api.github.com/users/LiangchangZ/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/LiangchangZ/subscriptions","organizations_url":"https://api.github.com/users/LiangchangZ/orgs","repos_url":"https://api.github.com/users/LiangchangZ/repos","events_url":"https://api.github.com/users/LiangchangZ/events{/privacy}","received_events_url":"https://api.github.com/users/LiangchangZ/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-05-28T15:44:18Z","updated_at":"2018-05-28T21:37:08Z","closed_at":null,"author_association":"NONE","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/21445","html_url":"https://github.com/apache/spark/pull/21445","diff_url":"https://github.com/apache/spark/pull/21445.diff","patch_url":"https://github.com/apache/spark/pull/21445.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nInvoke EpochTracker.incrementCurrentEpoch() before send ReportPartitionOffset message to epochCoordinator. Detail see the jira  https://issues.apache.org/jira/browse/SPARK-24404.\r\n\r\n## How was this patch tested?\r\n\r\nRun a CP application based on pull request #21353 #21332 and #21293"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/392606900","html_url":"https://github.com/apache/spark/pull/21445#issuecomment-392606900","issue_url":"https://api.github.com/repos/apache/spark/issues/21445","id":392606900,"user":{"login":"HeartSaVioR","id":1317309,"avatar_url":"https://avatars2.githubusercontent.com/u/1317309?v=4","gravatar_id":"","url":"https://api.github.com/users/HeartSaVioR","html_url":"https://github.com/HeartSaVioR","followers_url":"https://api.github.com/users/HeartSaVioR/followers","following_url":"https://api.github.com/users/HeartSaVioR/following{/other_user}","gists_url":"https://api.github.com/users/HeartSaVioR/gists{/gist_id}","starred_url":"https://api.github.com/users/HeartSaVioR/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/HeartSaVioR/subscriptions","organizations_url":"https://api.github.com/users/HeartSaVioR/orgs","repos_url":"https://api.github.com/users/HeartSaVioR/repos","events_url":"https://api.github.com/users/HeartSaVioR/events{/privacy}","received_events_url":"https://api.github.com/users/HeartSaVioR/received_events","type":"User","site_admin":false},"created_at":"2018-05-28T21:37:08Z","updated_at":"2018-05-28T21:37:08Z","author_association":"CONTRIBUTOR","body":"@LiangchangZ \r\nLooks like the patch is needed only with #21353 #21332 #21293 as of now, right? If then please state the condition in JIRA issue description as well as PR's description so that we don't get confused.\r\n\r\nThere's a case that reader and writer are composed together in a task (current state of continuous processing), and then after this patch it will be two places which increase epoch for the same thread. Please note that I'm commenting on top of current implementation, not considering #21353 #21332 #21293."}}
{"actor":{"display_login":"HeartSaVioR"}}