{"push_id":1349696355,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"7ab86244e30ca81eb4fa40ea77b4c2b8881cbab2","before":"de1c1ca5c9d6064d3b7b3711e3bfb08fa018abe8","commits":[{"sha":"7ab86244e30ca81eb4fa40ea77b4c2b8881cbab2","author":{"name":"Dilip Biswal","email":"6ab79ed79ae7ed4bf1dfe07d1c3e4c433e1f76a0@us.ibm.com"},"message":"[SPARK-17620][SQL] Determine Serde by hive.default.fileformat when Creating Hive Serde Tables\n\n## What changes were proposed in this pull request?\nMake sure the hive.default.fileformat is used to when creating the storage format metadata.\n\nOutput\n``` SQL\nscala> spark.sql(\"SET hive.default.fileformat=orc\")\nres1: org.apache.spark.sql.DataFrame = [key: string, value: string]\n\nscala> spark.sql(\"CREATE TABLE tmp_default(id INT)\")\nres2: org.apache.spark.sql.DataFrame = []\n```\nBefore\n```SQL\nscala> spark.sql(\"DESC FORMATTED tmp_default\").collect.foreach(println)\n..\n[# Storage Information,,]\n[SerDe Library:,org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe,]\n[InputFormat:,org.apache.hadoop.hive.ql.io.orc.OrcInputFormat,]\n[OutputFormat:,org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat,]\n[Compressed:,No,]\n[Storage Desc Parameters:,,]\n[  serialization.format,1,]\n```\nAfter\n```SQL\nscala> spark.sql(\"DESC FORMATTED tmp_default\").collect.foreach(println)\n..\n[# Storage Information,,]\n[SerDe Library:,org.apache.hadoop.hive.ql.io.orc.OrcSerde,]\n[InputFormat:,org.apache.hadoop.hive.ql.io.orc.OrcInputFormat,]\n[OutputFormat:,org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat,]\n[Compressed:,No,]\n[Storage Desc Parameters:,,]\n[  serialization.format,1,]\n\n```\n\n## How was this patch tested?\nAdded new tests to HiveDDLCommandSuite\n\nAuthor: Dilip Biswal <dbiswal@us.ibm.com>\n\nCloses #15190 from dilipbiswal/orc.","distinct":true,"url":"https://api.github.com/repos/dbtsai/spark/commits/7ab86244e30ca81eb4fa40ea77b4c2b8881cbab2"}]}
{"actor":{"display_login":"dbtsai-bot"}}