{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/10942","labels_url":"https://api.github.com/repos/apache/spark/issues/10942/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/10942/comments","events_url":"https://api.github.com/repos/apache/spark/issues/10942/events","html_url":"https://github.com/apache/spark/pull/10942","id":129040116,"number":10942,"title":"[SPARK-12850] [SQL] Support Bucket Pruning (Predicate Pushdown for Bucketed Tables)","user":{"login":"gatorsmile","id":11567269,"avatar_url":"https://avatars.githubusercontent.com/u/11567269?v=3","gravatar_id":"","url":"https://api.github.com/users/gatorsmile","html_url":"https://github.com/gatorsmile","followers_url":"https://api.github.com/users/gatorsmile/followers","following_url":"https://api.github.com/users/gatorsmile/following{/other_user}","gists_url":"https://api.github.com/users/gatorsmile/gists{/gist_id}","starred_url":"https://api.github.com/users/gatorsmile/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gatorsmile/subscriptions","organizations_url":"https://api.github.com/users/gatorsmile/orgs","repos_url":"https://api.github.com/users/gatorsmile/repos","events_url":"https://api.github.com/users/gatorsmile/events{/privacy}","received_events_url":"https://api.github.com/users/gatorsmile/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":13,"created_at":"2016-01-27T05:52:28Z","updated_at":"2016-01-30T18:15:57Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/10942","html_url":"https://github.com/apache/spark/pull/10942","diff_url":"https://github.com/apache/spark/pull/10942.diff","patch_url":"https://github.com/apache/spark/pull/10942.patch"},"body":"JIRA: https://issues.apache.org/jira/browse/SPARK-12850\r\n\r\nThis PR is to support bucket pruning when the predicates are `EqualTo`, `EqualNullSafe`, `IsNull`, `In`, and `InSet`. \r\n\r\nLike HIVE, in this PR, the bucket pruning works when the bucketing key has one and only one column.\r\n\r\nSo far, I do not find a way to verify how many buckets are actually scanned. However, I did verify it when doing the debug. Could you provide a suggestion how to do it properly? Thank you! @cloud-fan @yhuai @rxin @marmbrus \r\n\r\nBTW, we can add more cases to support complex predicate including `Or` and `And`. Please let me know if I should do it in this PR.\r\n\r\nMaybe we also need to add test cases to verify if bucket pruning works well for each data type. "},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/177265449","html_url":"https://github.com/apache/spark/pull/10942#issuecomment-177265449","issue_url":"https://api.github.com/repos/apache/spark/issues/10942","id":177265449,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-01-30T18:15:57Z","updated_at":"2016-01-30T18:15:57Z","body":"**[Test build #50445 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50445/consoleFull)** for PR 10942 at commit [`f5acd00`](https://github.com/apache/spark/commit/f5acd00d4c28a6e65ca8200ec93b1874e921e0f0)."}}