{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/15696","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/15696/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/15696/comments","events_url":"https://api.github.com/repos/apache/spark/issues/15696/events","html_url":"https://github.com/apache/spark/pull/15696","id":186353500,"number":15696,"title":"[SPARK-18024][SQL] Introduce an internal commit protocol API - WIP","user":{"login":"rxin","id":323388,"avatar_url":"https://avatars.githubusercontent.com/u/323388?v=3","gravatar_id":"","url":"https://api.github.com/users/rxin","html_url":"https://github.com/rxin","followers_url":"https://api.github.com/users/rxin/followers","following_url":"https://api.github.com/users/rxin/following{/other_user}","gists_url":"https://api.github.com/users/rxin/gists{/gist_id}","starred_url":"https://api.github.com/users/rxin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rxin/subscriptions","organizations_url":"https://api.github.com/users/rxin/orgs","repos_url":"https://api.github.com/users/rxin/repos","events_url":"https://api.github.com/users/rxin/events{/privacy}","received_events_url":"https://api.github.com/users/rxin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2016-10-31T17:59:36Z","updated_at":"2016-10-31T22:48:03Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/15696","html_url":"https://github.com/apache/spark/pull/15696","diff_url":"https://github.com/apache/spark/pull/15696.diff","patch_url":"https://github.com/apache/spark/pull/15696.patch"},"body":"## What changes were proposed in this pull request?\r\nThis is a work-in-progress pull request to introduce a commit protocol API that can be used by both streaming and batch to unify the write path.\r\n\r\nSome TODOs:\r\n\r\n- [x] Move output committer initialization entirely into the implemenation of FileCommitProtocol.\r\n- [ ] Make the choice of committer pluggable\r\n- [x] Simplify the logic to specify \"path\", perhaps by moving it from OutputWriter to OutputWriterFactory\r\n- [x] Allow the commit protocol to specify prefix file name\r\n\r\n## How was this patch tested?\r\nTBD"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/257442996","html_url":"https://github.com/apache/spark/pull/15696#issuecomment-257442996","issue_url":"https://api.github.com/repos/apache/spark/issues/15696","id":257442996,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-10-31T22:48:03Z","updated_at":"2016-10-31T22:48:03Z","body":"**[Test build #67841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67841/consoleFull)** for PR 15696 at commit [`2d7d373`](https://github.com/apache/spark/commit/2d7d373fe48d18037653c10424c8b1c978160958)."}}
{"actor":{"display_login":"SparkQA"}}