{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/16089","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/16089/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/16089/comments","events_url":"https://api.github.com/repos/apache/spark/issues/16089/events","html_url":"https://github.com/apache/spark/pull/16089","id":192704344,"number":16089,"title":"[SPARK-18658][SQL] Write text records directly to a FileOutputStream","user":{"login":"NathanHowell","id":170829,"avatar_url":"https://avatars.githubusercontent.com/u/170829?v=3","gravatar_id":"","url":"https://api.github.com/users/NathanHowell","html_url":"https://github.com/NathanHowell","followers_url":"https://api.github.com/users/NathanHowell/followers","following_url":"https://api.github.com/users/NathanHowell/following{/other_user}","gists_url":"https://api.github.com/users/NathanHowell/gists{/gist_id}","starred_url":"https://api.github.com/users/NathanHowell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/NathanHowell/subscriptions","organizations_url":"https://api.github.com/users/NathanHowell/orgs","repos_url":"https://api.github.com/users/NathanHowell/repos","events_url":"https://api.github.com/users/NathanHowell/events{/privacy}","received_events_url":"https://api.github.com/users/NathanHowell/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-11-30T22:55:10Z","updated_at":"2016-12-01T00:47:49Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/16089","html_url":"https://github.com/apache/spark/pull/16089","diff_url":"https://github.com/apache/spark/pull/16089.diff","patch_url":"https://github.com/apache/spark/pull/16089.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nThis replaces uses of `TextOutputFormat` with an `OutputStream`, which will either write directly to the filesystem or indirectly via a compressor (if so configured). This avoids intermediate buffering.\r\n\r\nThe inverse of this (reading directly from a stream) is necessary for streaming large JSON records (when `wholeFile` is enabled) so I wanted to keep the read and write paths symmetric.\r\n\r\n## How was this patch tested?\r\n\r\nExisting unit tests."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/264044845","html_url":"https://github.com/apache/spark/pull/16089#issuecomment-264044845","issue_url":"https://api.github.com/repos/apache/spark/issues/16089","id":264044845,"user":{"login":"NathanHowell","id":170829,"avatar_url":"https://avatars.githubusercontent.com/u/170829?v=3","gravatar_id":"","url":"https://api.github.com/users/NathanHowell","html_url":"https://github.com/NathanHowell","followers_url":"https://api.github.com/users/NathanHowell/followers","following_url":"https://api.github.com/users/NathanHowell/following{/other_user}","gists_url":"https://api.github.com/users/NathanHowell/gists{/gist_id}","starred_url":"https://api.github.com/users/NathanHowell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/NathanHowell/subscriptions","organizations_url":"https://api.github.com/users/NathanHowell/orgs","repos_url":"https://api.github.com/users/NathanHowell/repos","events_url":"https://api.github.com/users/NathanHowell/events{/privacy}","received_events_url":"https://api.github.com/users/NathanHowell/received_events","type":"User","site_admin":false},"created_at":"2016-12-01T00:47:49Z","updated_at":"2016-12-01T00:47:49Z","body":"Yep. It uses the Hadoop `FileSystem` class to open files, just like `TextOutputFormat` does."}}
{"actor":{"display_login":"NathanHowell"}}