{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/15024","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/15024/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/15024/comments","events_url":"https://api.github.com/repos/apache/spark/issues/15024/events","html_url":"https://github.com/apache/spark/pull/15024","id":176007525,"number":15024,"title":"[SPARK-17470][SQL] unify path for data source table and locationUri for hive serde table","user":{"login":"cloud-fan","id":3182036,"avatar_url":"https://avatars.githubusercontent.com/u/3182036?v=3","gravatar_id":"","url":"https://api.github.com/users/cloud-fan","html_url":"https://github.com/cloud-fan","followers_url":"https://api.github.com/users/cloud-fan/followers","following_url":"https://api.github.com/users/cloud-fan/following{/other_user}","gists_url":"https://api.github.com/users/cloud-fan/gists{/gist_id}","starred_url":"https://api.github.com/users/cloud-fan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cloud-fan/subscriptions","organizations_url":"https://api.github.com/users/cloud-fan/orgs","repos_url":"https://api.github.com/users/cloud-fan/repos","events_url":"https://api.github.com/users/cloud-fan/events{/privacy}","received_events_url":"https://api.github.com/users/cloud-fan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":15,"created_at":"2016-09-09T13:20:05Z","updated_at":"2016-09-16T17:02:43Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/15024","html_url":"https://github.com/apache/spark/pull/15024","diff_url":"https://github.com/apache/spark/pull/15024.diff","patch_url":"https://github.com/apache/spark/pull/15024.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nDue to a limitation of hive metastore(table location must be directory path, not file path), we always store `path` for data source table in storage properties, instead of the `locationUri` field. However, we should not expose this difference to `CatalogTable` level, but just treat it as a hack in `HiveExternalCatalog`, like we store table schema of data source table in table properties.\r\n\r\nThis PR unifies `path` and `locationUri` outside of `HiveExternalCatalog`, both data source table and hive serde table should use the `locationUri` field.\r\n\r\nThis PR also unifies the way we handle default table location for managed table. Previously, the default table location of hive serde managed table is set by external catalog, but the one of data source table is set by command. After this PR, we follow the hive way and the default table location is always set by external catalog.\r\n\r\n## How was this patch tested?\r\n\r\nexisting tests.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/247653477","html_url":"https://github.com/apache/spark/pull/15024#issuecomment-247653477","issue_url":"https://api.github.com/repos/apache/spark/issues/15024","id":247653477,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-09-16T17:02:43Z","updated_at":"2016-09-16T17:02:43Z","body":"**[Test build #65497 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65497/consoleFull)** for PR 15024 at commit [`5dfdc35`](https://github.com/apache/spark/commit/5dfdc357ea2f1a73e31a060ff027872e62e99c58)."}}
{"actor":{"display_login":"SparkQA"}}