{"push_id":1099077877,"size":10,"distinct_size":10,"ref":"refs/heads/JDK_TEST","head":"8134ac3a06204e7b84a5138bf890524e14c27126","before":"3c9e7356a7b53d376a234e58cc698dcd5e51c99e","commits":[{"sha":"63db2bd283a430971d85f2a7b06dac77723c56fa","author":{"email":"e6f14efef9fae0ae8f92d04007faea68035873ce@databricks.com","name":"Cheng Lian"},"message":"[MINOR][BUILD] Adds spark-warehouse/ to .gitignore\n\n## What changes were proposed in this pull request?\n\nAdds spark-warehouse/ to `.gitignore`.\n\n## How was this patch tested?\n\nN/A\n\nAuthor: Cheng Lian <lian@databricks.com>\n\nCloses #12929 from liancheng/gitignore-spark-warehouse.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/63db2bd283a430971d85f2a7b06dac77723c56fa"},{"sha":"8cba57a75cf9e29b54d97366a039a97a2f305d5d","author":{"email":"905db6c57c9ba2de5402239d136139da9b5d0058@gmail.com","name":"gatorsmile"},"message":"[SPARK-14124][SQL][FOLLOWUP] Implement Database-related DDL Commands\n\n#### What changes were proposed in this pull request?\n\nFirst, a few test cases failed in mac OS X  because the property value of `java.io.tmpdir` does not include a trailing slash on some platform. Hive always removes the last trailing slash. For example, what I got in the web:\n```\nWin NT  --> C:\\TEMP\\\nWin XP  --> C:\\TEMP\nSolaris --> /var/tmp/\nLinux   --> /var/tmp\n```\nSecond, a couple of test cases are added to verify if the commands work properly.\n\n#### How was this patch tested?\nAdded a test case for it and correct the previous test cases.\n\nAuthor: gatorsmile <gatorsmile@gmail.com>\nAuthor: xiaoli <lixiao1983@gmail.com>\nAuthor: Xiao Li <xiaoli@Xiaos-MacBook-Pro.local>\n\nCloses #12081 from gatorsmile/mkdir.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/8cba57a75cf9e29b54d97366a039a97a2f305d5d"},{"sha":"ed6f3f8a5f3a6bf7c53e13c2798de398c9a526a6","author":{"email":"ad9280c159074d9ec90899b584f520606e83d10e@techaddict.me","name":"Sandeep Singh"},"message":"[SPARK-15072][SQL][REPL][EXAMPLES] Remove SparkSession.withHiveSupport\n\n## What changes were proposed in this pull request?\nRemoving the `withHiveSupport` method of `SparkSession`, instead use `enableHiveSupport`\n\n## How was this patch tested?\nran tests locally\n\nAuthor: Sandeep Singh <sandeep@techaddict.me>\n\nCloses #12851 from techaddict/SPARK-15072.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/ed6f3f8a5f3a6bf7c53e13c2798de398c9a526a6"},{"sha":"bb9991dec5dd631b22a05e2e1b83b9082a845e8f","author":{"email":"b59cd5ce8cb5ae44d26fc6984be1f84cf74771a7@databricks.com","name":"Shixiong Zhu"},"message":"[SPARK-15135][SQL] Make sure SparkSession thread safe\n\n## What changes were proposed in this pull request?\n\nWent through SparkSession and its members and fixed non-thread-safe classes used by SparkSession\n\n## How was this patch tested?\n\nExisting unit tests\n\nAuthor: Shixiong Zhu <shixiong@databricks.com>\n\nCloses #12915 from zsxwing/spark-session-thread-safe.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/bb9991dec5dd631b22a05e2e1b83b9082a845e8f"},{"sha":"2c170dd3d731bd848d62265431795e1c141d75d7","author":{"email":"6ff48b33cbb828151035af58a92f18a39f1d1036@apache.org","name":"Dongjoon Hyun"},"message":"[SPARK-15134][EXAMPLE] Indent SparkSession builder patterns and update binary_classification_metrics_example.py\n\n## What changes were proposed in this pull request?\n\nThis issue addresses the comments in SPARK-15031 and also fix java-linter errors.\n- Use multiline format in SparkSession builder patterns.\n- Update `binary_classification_metrics_example.py` to use `SparkSession`.\n- Fix Java Linter errors (in SPARK-13745, SPARK-15031, and so far)\n\n## How was this patch tested?\n\nAfter passing the Jenkins tests and run `dev/lint-java` manually.\n\nAuthor: Dongjoon Hyun <dongjoon@apache.org>\n\nCloses #12911 from dongjoon-hyun/SPARK-15134.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/2c170dd3d731bd848d62265431795e1c141d75d7"},{"sha":"5c47db06570e65d3f5544d6f26bbdf893e275b94","author":{"email":"35482ce1f662ec95dafd86a46864c552bace72c8@gmail.com","name":"depend"},"message":"[SPARK-15158][CORE] downgrade shouldRollover message to debug level\n\n## What changes were proposed in this pull request?\nset log level to debug when check shouldRollover\n\n## How was this patch tested?\nIt's tested manually.\n\nAuthor: depend <depend@gmail.com>\n\nCloses #12931 from depend/master.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/5c47db06570e65d3f5544d6f26bbdf893e275b94"},{"sha":"08db491265a3b50e31993ac6aa07c3f0dd08cdbb","author":{"email":"4c9a82ce72ca2519f38d0af0abbb4cecb9fceca9@apache.org","name":"Ryan Blue"},"message":"[SPARK-9926] Parallelize partition logic in UnionRDD.\n\nThis patch has the new logic from #8512 that uses a parallel collection to compute partitions in UnionRDD. The rest of #8512 added an alternative code path for calculating splits in S3, but that isn't necessary to get the same speedup. The underlying problem wasn't that bulk listing wasn't used, it was that an extra FileStatus was retrieved for each file. The fix was just committed as [HADOOP-12810](https://issues.apache.org/jira/browse/HADOOP-12810). (I think the original commit also used a single prefix to enumerate all paths, but that isn't always helpful and it was removed in later versions so there is no need for SparkS3Utils.)\n\nI tested this using the same table that piapiaozhexiu was using. Calculating splits for a 10-day period took 25 seconds with this change and HADOOP-12810, which is on par with the results from #8512.\n\nAuthor: Ryan Blue <blue@apache.org>\nAuthor: Cheolsoo Park <cheolsoop@netflix.com>\n\nCloses #11242 from rdblue/SPARK-9926-parallelize-union-rdd.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/08db491265a3b50e31993ac6aa07c3f0dd08cdbb"},{"sha":"02c07e8999dca545849cb3aa758a624dc51cd1e9","author":{"email":"ee7669731148a67ed053406d4e2088f2bc2c2de0@us.ibm.com","name":"Dilip Biswal"},"message":"[SPARK-14893][SQL] Re-enable HiveSparkSubmitSuite SPARK-8489 test after HiveContext is removed\n\n## What changes were proposed in this pull request?\n\nEnable the test that was disabled when HiveContext was removed.\n\n## How was this patch tested?\n\nMade sure the enabled test passes with the new jar.\n\nAuthor: Dilip Biswal <dbiswal@us.ibm.com>\n\nCloses #12924 from dilipbiswal/spark-14893.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/02c07e8999dca545849cb3aa758a624dc51cd1e9"},{"sha":"55283fffa42bc3bd444eb211ef1c756a0918bf50","author":{"email":"6ff48b33cbb828151035af58a92f18a39f1d1036@apache.org","name":"Dongjoon Hyun"},"message":"Use Travis CI for JDK7/8 compilation and lint.","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/55283fffa42bc3bd444eb211ef1c756a0918bf50"},{"sha":"8134ac3a06204e7b84a5138bf890524e14c27126","author":{"email":"6ff48b33cbb828151035af58a92f18a39f1d1036@apache.org","name":"Dongjoon Hyun"},"message":"Ignore hive","distinct":true,"url":"https://api.github.com/repos/dongjoon-hyun/spark/commits/8134ac3a06204e7b84a5138bf890524e14c27126"}]}