{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/21877","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/21877/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/21877/comments","events_url":"https://api.github.com/repos/apache/spark/issues/21877/events","html_url":"https://github.com/apache/spark/pull/21877","id":344638560,"node_id":"MDExOlB1bGxSZXF1ZXN0MjAzOTg3ODI1","number":21877,"title":"[SPARK-24923][SQL][WIP] Add unpartitioned CTAS and RTAS support for DataSourceV2","user":{"login":"rdblue","id":87915,"node_id":"MDQ6VXNlcjg3OTE1","avatar_url":"https://avatars1.githubusercontent.com/u/87915?v=4","gravatar_id":"","url":"https://api.github.com/users/rdblue","html_url":"https://github.com/rdblue","followers_url":"https://api.github.com/users/rdblue/followers","following_url":"https://api.github.com/users/rdblue/following{/other_user}","gists_url":"https://api.github.com/users/rdblue/gists{/gist_id}","starred_url":"https://api.github.com/users/rdblue/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rdblue/subscriptions","organizations_url":"https://api.github.com/users/rdblue/orgs","repos_url":"https://api.github.com/users/rdblue/repos","events_url":"https://api.github.com/users/rdblue/events{/privacy}","received_events_url":"https://api.github.com/users/rdblue/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":13,"created_at":"2018-07-25T23:09:40Z","updated_at":"2018-12-10T06:09:51Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/21877","html_url":"https://github.com/apache/spark/pull/21877","diff_url":"https://github.com/apache/spark/pull/21877.diff","patch_url":"https://github.com/apache/spark/pull/21877.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\n* Remove extends from `ReadSupport` and `WriteSupport` classes for use with `Table`\r\n* Add CTAS and RTAS logical plans\r\n* Refactor physical write plans so AppendData, CTAS, and RTAS use the same base class\r\n* Add support for `TableCatalog` to `DataFrameReader` and `DataFrameWriter`\r\n* Add `TableV2Relation` for tables that are loaded by `TableCatalog` and have no `DataSource` instance\r\n* Move implicit helpers into `DataSourceV2Implicits` to avoid future churn\r\n\r\nNote that this doesn't handle `partitionBy` in `DataFrameWriter`. Adding support for partitioned tables will require validation rules.\r\n\r\nThis is based on unmerged work and includes the commits from #21306 and #21305.\r\n\r\n## How was this patch tested?\r\n\r\nAdding unit tests for CTAS and RTAS."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/445698777","html_url":"https://github.com/apache/spark/pull/21877#issuecomment-445698777","issue_url":"https://api.github.com/repos/apache/spark/issues/21877","id":445698777,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0NTY5ODc3Nw==","user":{"login":"AmplabJenkins","id":4031291,"node_id":"MDQ6VXNlcjQwMzEyOTE=","avatar_url":"https://avatars3.githubusercontent.com/u/4031291?v=4","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2018-12-10T06:09:51Z","updated_at":"2018-12-10T06:09:51Z","author_association":"NONE","body":"Test FAILed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/99893/\nTest FAILed."}}
{"actor":{"display_login":"AmplabJenkins"}}