{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/15511","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/15511/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/15511/comments","events_url":"https://api.github.com/repos/apache/spark/issues/15511/events","html_url":"https://github.com/apache/spark/pull/15511","id":183356757,"number":15511,"title":"[SPARK-17969]I think it's user unfriendly to process standard json file with DataFrame","user":{"login":"codlife","id":7194685,"avatar_url":"https://avatars.githubusercontent.com/u/7194685?v=3","gravatar_id":"","url":"https://api.github.com/users/codlife","html_url":"https://github.com/codlife","followers_url":"https://api.github.com/users/codlife/followers","following_url":"https://api.github.com/users/codlife/following{/other_user}","gists_url":"https://api.github.com/users/codlife/gists{/gist_id}","starred_url":"https://api.github.com/users/codlife/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/codlife/subscriptions","organizations_url":"https://api.github.com/users/codlife/orgs","repos_url":"https://api.github.com/users/codlife/repos","events_url":"https://api.github.com/users/codlife/events{/privacy}","received_events_url":"https://api.github.com/users/codlife/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-10-17T08:39:35Z","updated_at":"2016-10-17T10:09:25Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/15511","html_url":"https://github.com/apache/spark/pull/15511","diff_url":"https://github.com/apache/spark/pull/15511.diff","patch_url":"https://github.com/apache/spark/pull/15511.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nCurrently, with DataFrame API, we can't load standard json file directly, so we can provide an override method to process this.\r\n\r\n## How was this patch tested?\r\nmanual tests\r\n\r\nPlease review https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark before opening a pull request.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/254167055","html_url":"https://github.com/apache/spark/pull/15511#issuecomment-254167055","issue_url":"https://api.github.com/repos/apache/spark/issues/15511","id":254167055,"user":{"login":"srowen","id":822522,"avatar_url":"https://avatars.githubusercontent.com/u/822522?v=3","gravatar_id":"","url":"https://api.github.com/users/srowen","html_url":"https://github.com/srowen","followers_url":"https://api.github.com/users/srowen/followers","following_url":"https://api.github.com/users/srowen/following{/other_user}","gists_url":"https://api.github.com/users/srowen/gists{/gist_id}","starred_url":"https://api.github.com/users/srowen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/srowen/subscriptions","organizations_url":"https://api.github.com/users/srowen/orgs","repos_url":"https://api.github.com/users/srowen/repos","events_url":"https://api.github.com/users/srowen/events{/privacy}","received_events_url":"https://api.github.com/users/srowen/received_events","type":"User","site_admin":false},"created_at":"2016-10-17T10:09:25Z","updated_at":"2016-10-17T10:09:25Z","body":"OK, I think in both cases \"standard\" JSON is read, and in both cases, each record is a JSON document. These aren't different cases. If you mean to read small JSON files as records, you just use wholeTextFiles, as you show. I do not think wrapping this up with an extra flag helps enough to justify this because callers can easily implement this. There are a hundred other variations on this, and the reason we don't implement them all is exactly because there are so many variations to bottle up like this."}}
{"actor":{"display_login":"srowen"}}