{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/13373","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/13373/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/13373/comments","events_url":"https://api.github.com/repos/apache/spark/issues/13373/events","html_url":"https://github.com/apache/spark/pull/13373","id":157322402,"number":13373,"title":"[SPARK-15616] [SQL] Metastore relation should fallback to HDFS size of partitions that are involved in Query for JoinSelection.","user":{"login":"lianhuiwang","id":545478,"avatar_url":"https://avatars.githubusercontent.com/u/545478?v=3","gravatar_id":"","url":"https://api.github.com/users/lianhuiwang","html_url":"https://github.com/lianhuiwang","followers_url":"https://api.github.com/users/lianhuiwang/followers","following_url":"https://api.github.com/users/lianhuiwang/following{/other_user}","gists_url":"https://api.github.com/users/lianhuiwang/gists{/gist_id}","starred_url":"https://api.github.com/users/lianhuiwang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lianhuiwang/subscriptions","organizations_url":"https://api.github.com/users/lianhuiwang/orgs","repos_url":"https://api.github.com/users/lianhuiwang/repos","events_url":"https://api.github.com/users/lianhuiwang/events{/privacy}","received_events_url":"https://api.github.com/users/lianhuiwang/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":19,"created_at":"2016-05-28T05:41:40Z","updated_at":"2016-10-29T17:37:31Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/13373","html_url":"https://github.com/apache/spark/pull/13373","diff_url":"https://github.com/apache/spark/pull/13373.diff","patch_url":"https://github.com/apache/spark/pull/13373.patch"},"body":"## What changes were proposed in this pull request?\r\nCurrently if some partitions of a partitioned table are used in join operation we rely on Metastore returned size of table to calculate if we can convert the operation to Broadcast join. \r\nif Filter can prune some partitions, Hive can prune partition before determining to use broadcast joins according to HDFS size of partitions that are involved in Query.So sparkSQL needs it that can improve join's performance for partitioned table.\r\n\r\n## How was this patch tested?\r\nintegration tests"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/257104899","html_url":"https://github.com/apache/spark/pull/13373#issuecomment-257104899","issue_url":"https://api.github.com/repos/apache/spark/issues/13373","id":257104899,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-10-29T17:37:31Z","updated_at":"2016-10-29T17:37:31Z","body":"**[Test build #67771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67771/consoleFull)** for PR 13373 at commit [`1a63649`](https://github.com/apache/spark/commit/1a63649b1008777b62dfb4a21ca82075f8aa9ddc)."}}
{"actor":{"display_login":"SparkQA"}}