{"push_id":1243276691,"size":6,"distinct_size":6,"ref":"refs/heads/master","head":"11a6844bebbad1968bcdc295ab2de31c60dc0874","before":"41a7dbdd34d2641d42eb00828f16285089356aa9","commits":[{"sha":"2b10ebe6ac1cdc2c723cb47e4b88cfbf39e0de08","author":{"name":"gatorsmile","email":"ea6589371ad7a107e4268706d7d8403e3ba585bb@gmail.com"},"message":"[SPARK-16185][SQL] Better Error Messages When Creating Table As Select Without Enabling Hive Support\n\n#### What changes were proposed in this pull request?\nWhen we do not turn on the Hive Support, the following query generates a confusing error message by Planner:\n```Scala\nsql(\"CREATE TABLE t2 SELECT a, b from t1\")\n```\n\n```\nassertion failed: No plan for CreateTable CatalogTable(\n\tTable: `t2`\n\tCreated: Tue Aug 09 23:45:32 PDT 2016\n\tLast Access: Wed Dec 31 15:59:59 PST 1969\n\tType: MANAGED\n\tProvider: hive\n\tStorage(InputFormat: org.apache.hadoop.mapred.TextInputFormat, OutputFormat: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat)), ErrorIfExists\n+- Relation[a#19L,b#20L] parquet\n\njava.lang.AssertionError: assertion failed: No plan for CreateTable CatalogTable(\n\tTable: `t2`\n\tCreated: Tue Aug 09 23:45:32 PDT 2016\n\tLast Access: Wed Dec 31 15:59:59 PST 1969\n\tType: MANAGED\n\tProvider: hive\n\tStorage(InputFormat: org.apache.hadoop.mapred.TextInputFormat, OutputFormat: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat)), ErrorIfExists\n+- Relation[a#19L,b#20L] parquet\n```\n\nThis PR is to issue a better error message:\n```\nHive support is required to use CREATE Hive TABLE AS SELECT\n```\n\n#### How was this patch tested?\nAdded test cases in `DDLSuite.scala`\n\nAuthor: gatorsmile <gatorsmile@gmail.com>\n\nCloses #13886 from gatorsmile/createCatalogedTableAsSelect.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/2b10ebe6ac1cdc2c723cb47e4b88cfbf39e0de08"},{"sha":"bfda53f63a31bf2e8b72ab9e85896a4bec1644e8","author":{"name":"Andrew Ash","email":"6b7c097d961f68685fc978cf91eeae17be6cbb45@andrewash.com"},"message":"Typo: Fow -> For\n\nAuthor: Andrew Ash <andrew@andrewash.com>\n\nCloses #14563 from ash211/patch-8.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/bfda53f63a31bf2e8b72ab9e85896a4bec1644e8"},{"sha":"eca58755fbbc11937b335ad953a3caff89b818e6","author":{"name":"Timothy Chen","email":"7b57bd4213f8c2618210e049eecc1490b865c2b9@gmail.com"},"message":"[SPARK-16927][SPARK-16923] Override task properties at dispatcher.\n\n## What changes were proposed in this pull request?\n\n- enable setting default properties for all jobs submitted through the dispatcher [SPARK-16927]\n- remove duplication of conf vars on cluster submitted jobs [SPARK-16923] (this is a small fix, so I'm including in the same PR)\n\n## How was this patch tested?\n\nmesos/spark integration test suite\nmanual testing\n\nAuthor: Timothy Chen <tnachen@gmail.com>\n\nCloses #14511 from mgummelt/override-props.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/eca58755fbbc11937b335ad953a3caff89b818e6"},{"sha":"0578ff9681edbaab4ae68f67272dc3d4d890d53b","author":{"name":"Sean Owen","email":"4c59f357315334980589bde1049040bf6de6532c@cloudera.com"},"message":"[SPARK-16324][SQL] regexp_extract should doc that it returns empty string when match fails\n\n## What changes were proposed in this pull request?\n\nDoc that regexp_extract returns empty string when regex or group does not match\n\n## How was this patch tested?\n\nJenkins test, with a few new test cases\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #14525 from srowen/SPARK-16324.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/0578ff9681edbaab4ae68f67272dc3d4d890d53b"},{"sha":"b9f8a117097bc102e261b68f38a679d16e19f2e2","author":{"name":"petermaxlee","email":"ac6c8937256e5ff211210b88da2643bdd0703390@gmail.com"},"message":"[SPARK-16866][SQL] Infrastructure for file-based SQL end-to-end tests\n\n## What changes were proposed in this pull request?\nThis patch introduces SQLQueryTestSuite, a basic framework for end-to-end SQL test cases defined in spark/sql/core/src/test/resources/sql-tests. This is a more standard way to test SQL queries end-to-end in different open source database systems, because it is more manageable to work with files.\n\nThis is inspired by HiveCompatibilitySuite, but simplified for general Spark SQL tests. Once this is merged, I can work towards porting SQLQuerySuite over, and eventually also move the existing HiveCompatibilitySuite to use this framework.\n\nUnlike HiveCompatibilitySuite, SQLQueryTestSuite compares both the output schema and the output data (in string form).\n\nWhen there is a mismatch, the error message looks like the following:\n\n```\n[info] - blacklist.sql !!! IGNORED !!!\n[info] - number-format.sql *** FAILED *** (2 seconds, 405 milliseconds)\n[info]   Expected \"...147483648\t-214748364[8]\", but got \"...147483648\t-214748364[9]\" Result should match for query #1 (SQLQueryTestSuite.scala:171)\n[info]   org.scalatest.exceptions.TestFailedException:\n[info]   at org.scalatest.Assertions$class.newAssertionFailedException(Assertions.scala:495)\n[info]   at org.scalatest.FunSuite.newAssertionFailedException(FunSuite.scala:1555)\n[info]   at org.scalatest.Assertions$class.assertResult(Assertions.scala:1171)\n```\n\n## How was this patch tested?\nThis is a test infrastructure change.\n\nAuthor: petermaxlee <petermaxlee@gmail.com>\n\nCloses #14472 from petermaxlee/SPARK-16866.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/b9f8a117097bc102e261b68f38a679d16e19f2e2"},{"sha":"11a6844bebbad1968bcdc295ab2de31c60dc0874","author":{"name":"avulanov","email":"a3c0fc8c1ed6c33884031b4020d91cf67cf44186@yandex.ru"},"message":"[SPARK-15899][SQL] Fix the construction of the file path with hadoop Path\n\n## What changes were proposed in this pull request?\n\nFix the construction of the file path. Previous way of construction caused the creation of incorrect path on Windows.\n\n## How was this patch tested?\n\nRun SQL unit tests on Windows\n\nAuthor: avulanov <nashb@yandex.ru>\n\nCloses #13868 from avulanov/SPARK-15899-file.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/11a6844bebbad1968bcdc295ab2de31c60dc0874"}]}
{"actor":{"display_login":"dongjoon-hyun"}}