{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/21898","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/21898/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/21898/comments","events_url":"https://api.github.com/repos/apache/spark/issues/21898/events","html_url":"https://github.com/apache/spark/pull/21898","id":345320304,"node_id":"MDExOlB1bGxSZXF1ZXN0MjA0NTA0MTMx","number":21898,"title":"[SPARK-24817][Core] Implement BarrierTaskContext.barrier()","user":{"login":"jiangxb1987","id":4784782,"node_id":"MDQ6VXNlcjQ3ODQ3ODI=","avatar_url":"https://avatars1.githubusercontent.com/u/4784782?v=4","gravatar_id":"","url":"https://api.github.com/users/jiangxb1987","html_url":"https://github.com/jiangxb1987","followers_url":"https://api.github.com/users/jiangxb1987/followers","following_url":"https://api.github.com/users/jiangxb1987/following{/other_user}","gists_url":"https://api.github.com/users/jiangxb1987/gists{/gist_id}","starred_url":"https://api.github.com/users/jiangxb1987/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jiangxb1987/subscriptions","organizations_url":"https://api.github.com/users/jiangxb1987/orgs","repos_url":"https://api.github.com/users/jiangxb1987/repos","events_url":"https://api.github.com/users/jiangxb1987/events{/privacy}","received_events_url":"https://api.github.com/users/jiangxb1987/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-07-27T18:16:39Z","updated_at":"2018-07-29T07:07:41Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/21898","html_url":"https://github.com/apache/spark/pull/21898","diff_url":"https://github.com/apache/spark/pull/21898.diff","patch_url":"https://github.com/apache/spark/pull/21898.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nImplement BarrierTaskContext.barrier(), to support global sync between all the tasks in a barrier stage.\r\nThe function set a global barrier and waits until all tasks in this stage hit this barrier. Similar to MPI_Barrier function in MPI, the barrier() function call blocks until all tasks in the same stage have reached this routine. The global sync shall finish immediately once all tasks in the same barrier stage reaches the same barrier.\r\n\r\nThis PR implements BarrierTaskContext.barrier() based on netty-based RPC client, introduces new `BarrierCoordinator` and new `BarrierCoordinatorMessage`, and new config to handle timeout issue.\r\n\r\n## How was this patch tested?\r\nAdd `BarrierTaskContextSuite` to test `BarrierTaskContext.barrier()`"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/408656947","html_url":"https://github.com/apache/spark/pull/21898#issuecomment-408656947","issue_url":"https://api.github.com/repos/apache/spark/issues/21898","id":408656947,"node_id":"MDEyOklzc3VlQ29tbWVudDQwODY1Njk0Nw==","user":{"login":"jiangxb1987","id":4784782,"node_id":"MDQ6VXNlcjQ3ODQ3ODI=","avatar_url":"https://avatars1.githubusercontent.com/u/4784782?v=4","gravatar_id":"","url":"https://api.github.com/users/jiangxb1987","html_url":"https://github.com/jiangxb1987","followers_url":"https://api.github.com/users/jiangxb1987/followers","following_url":"https://api.github.com/users/jiangxb1987/following{/other_user}","gists_url":"https://api.github.com/users/jiangxb1987/gists{/gist_id}","starred_url":"https://api.github.com/users/jiangxb1987/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jiangxb1987/subscriptions","organizations_url":"https://api.github.com/users/jiangxb1987/orgs","repos_url":"https://api.github.com/users/jiangxb1987/repos","events_url":"https://api.github.com/users/jiangxb1987/events{/privacy}","received_events_url":"https://api.github.com/users/jiangxb1987/received_events","type":"User","site_admin":false},"created_at":"2018-07-29T07:07:41Z","updated_at":"2018-07-29T07:07:41Z","author_association":"CONTRIBUTOR","body":"retest this please"}}
{"actor":{"display_login":"jiangxb1987"}}