{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/22123","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/22123/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/22123/comments","events_url":"https://api.github.com/repos/apache/spark/issues/22123/events","html_url":"https://github.com/apache/spark/pull/22123","id":351268119,"node_id":"MDExOlB1bGxSZXF1ZXN0MjA4OTA3Njg2","number":22123,"title":"[SPARK-25134][SQL] Csv column pruning with checking of headers throws incorrect error","user":{"login":"koertkuipers","id":821284,"node_id":"MDQ6VXNlcjgyMTI4NA==","avatar_url":"https://avatars3.githubusercontent.com/u/821284?v=4","gravatar_id":"","url":"https://api.github.com/users/koertkuipers","html_url":"https://github.com/koertkuipers","followers_url":"https://api.github.com/users/koertkuipers/followers","following_url":"https://api.github.com/users/koertkuipers/following{/other_user}","gists_url":"https://api.github.com/users/koertkuipers/gists{/gist_id}","starred_url":"https://api.github.com/users/koertkuipers/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/koertkuipers/subscriptions","organizations_url":"https://api.github.com/users/koertkuipers/orgs","repos_url":"https://api.github.com/users/koertkuipers/repos","events_url":"https://api.github.com/users/koertkuipers/events{/privacy}","received_events_url":"https://api.github.com/users/koertkuipers/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-08-16T15:58:25Z","updated_at":"2018-08-17T07:05:01Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/22123","html_url":"https://github.com/apache/spark/pull/22123","diff_url":"https://github.com/apache/spark/pull/22123.diff","patch_url":"https://github.com/apache/spark/pull/22123.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nWhen column pruning is turned on the checking of headers in the csv should only be for the fields in the requiredSchema, not the dataSchema, because column pruning means only requiredSchema is read.\r\n\r\n## How was this patch tested?\r\n\r\nAdded 2 unit tests where column pruning is turned on/off and csv headers are checked againt schema \r\n\r\nPlease review http://spark.apache.org/contributing.html before opening a pull request.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/413777292","html_url":"https://github.com/apache/spark/pull/22123#issuecomment-413777292","issue_url":"https://api.github.com/repos/apache/spark/issues/22123","id":413777292,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMzc3NzI5Mg==","user":{"login":"SparkQA","id":8108735,"node_id":"MDQ6VXNlcjgxMDg3MzU=","avatar_url":"https://avatars1.githubusercontent.com/u/8108735?v=4","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2018-08-17T07:05:01Z","updated_at":"2018-08-17T07:05:01Z","author_association":"NONE","body":"**[Test build #94875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/94875/testReport)** for PR 22123 at commit [`09c986c`](https://github.com/apache/spark/commit/09c986c7e9586346255ba7631db83f2f88fe1625).\n * This patch **fails due to an unknown error code, -9**.\n * This patch merges cleanly.\n * This patch adds no public classes."}}
{"actor":{"display_login":"SparkQA"}}