{"push_id":927292445,"size":101,"distinct_size":101,"ref":"refs/heads/master","head":"794ea553bd0fcfece15b610b47ee86d6644134c9","before":"5adec63a922d6f60cd6cb87ebdab61a17131ac1a","commits":[{"sha":"c9dbfcc653b868fdb28106c1d1bcb6cb6caac6cc","author":{"email":"d24118b4297e1ecf0c990d6935f5f9e6e4fd7701@gmail.com","name":"Liang-Chi Hsieh"},"message":"[SPARK-11743][SQL] Move the test for arrayOfUDT\n\nA following pr for #9712. Move the test for arrayOfUDT.\n\nAuthor: Liang-Chi Hsieh <viirya@gmail.com>\n\nCloses #10538 from viirya/move-udt-test.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/c9dbfcc653b868fdb28106c1d1bcb6cb6caac6cc"},{"sha":"a59a357cae82ca9b6926b55903ce4f12ae131735","author":{"email":"8283fd24ce58e0bb0d6bf349e9064fef42c4d84e@cloudera.com","name":"Marcelo Vanzin"},"message":"[SPARK-3873][MLLIB] Import order fixes.\n\nA slight adjustment to the checker configuration was needed; there is\na handful of warnings still left, but those are because of a bug in\nthe checker that I'll fix separately (before enabling errors for the\nchecker, of course).\n\nAuthor: Marcelo Vanzin <vanzin@cloudera.com>\n\nCloses #10535 from vanzin/SPARK-3873-mllib.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/a59a357cae82ca9b6926b55903ce4f12ae131735"},{"sha":"ad5b7cfcca7a5feb83b9ed94b6e725c6d789579b","author":{"email":"d24118b4297e1ecf0c990d6935f5f9e6e4fd7701@gmail.com","name":"Liang-Chi Hsieh"},"message":"[SPARK-12409][SPARK-12387][SPARK-12391][SQL] Refactor filter pushdown for JDBCRDD and add few filters\n\nThis patch refactors the filter pushdown for JDBCRDD and also adds few filters.\n\nAdded filters are basically from #10468 with some refactoring. Test cases are from #10468.\n\nAuthor: Liang-Chi Hsieh <viirya@gmail.com>\n\nCloses #10470 from viirya/refactor-jdbc-filter.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/ad5b7cfcca7a5feb83b9ed94b6e725c6d789579b"},{"sha":"01a29866b1da23157fec41e4b037b7dbe4ffda16","author":{"email":"e6f14efef9fae0ae8f92d04007faea68035873ce@databricks.com","name":"Cheng Lian"},"message":"[SPARK-12592][SQL][TEST] Don't mute Spark loggers in TestHive.reset()\n\nThere's a hack done in `TestHive.reset()`, which intended to mute noisy Hive loggers. However, Spark testing loggers are also muted.\n\nAuthor: Cheng Lian <lian@databricks.com>\n\nCloses #10540 from liancheng/spark-12592.dont-mute-spark-loggers.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/01a29866b1da23157fec41e4b037b7dbe4ffda16"},{"sha":"6c20b3c0871609cbbb1de8e12edd3cad318fc14e","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"Disable test-dependencies.sh.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/6c20b3c0871609cbbb1de8e12edd3cad318fc14e"},{"sha":"0da7bd50ddf0fb9e0e8aeadb9c7fb3edf6f0ee6e","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-12286][SPARK-12290][SPARK-12294][SPARK-12284][SQL] always output UnsafeRow\n\nIt's confusing that some operator output UnsafeRow but some not, easy to make mistake.\n\nThis PR change to only output UnsafeRow for all the operators (SparkPlan), removed the rule to insert Unsafe/Safe conversions. For those that can't output UnsafeRow directly, added UnsafeProjection into them.\n\nCloses #10330\n\ncc JoshRosen rxin\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #10511 from davies/unsafe_row.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/0da7bd50ddf0fb9e0e8aeadb9c7fb3edf6f0ee6e"},{"sha":"44ee920fd49d35b421ae562ea99bcc8f2b98ced6","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"Revert \"[SPARK-12286][SPARK-12290][SPARK-12294][SPARK-12284][SQL] always output UnsafeRow\"\n\nThis reverts commit 0da7bd50ddf0fb9e0e8aeadb9c7fb3edf6f0ee6e.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/44ee920fd49d35b421ae562ea99bcc8f2b98ced6"},{"sha":"970635a9f8d7f64708a9fcae0b231c570f3f2c51","author":{"email":"679c4ded150c6b9a8052807f108ce836961fed8d@questtec.nl","name":"Herman van Hovell"},"message":"[SPARK-12362][SQL][WIP] Inline Hive Parser\n\nThis PR inlines the Hive SQL parser in Spark SQL.\n\nThe previous (merged) incarnation of this PR passed all tests, but had and still has problems with the build. These problems are caused by a the fact that - for some reason - in some cases the ANTLR generated code is not included in the compilation fase.\n\nThis PR is a WIP and should not be merged until we have sorted out the build issues.\n\nAuthor: Herman van Hovell <hvanhovell@questtec.nl>\nAuthor: Nong Li <nong@databricks.com>\nAuthor: Nong Li <nongli@gmail.com>\n\nCloses #10525 from hvanhovell/SPARK-12362.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/970635a9f8d7f64708a9fcae0b231c570f3f2c51"},{"sha":"94f7a12b3c8e4a6ecd969893e562feb7ffba4c24","author":{"email":"2680965ad5aae29275c8fb10150cb10f5554e78b@gmail.com","name":"hyukjinkwon"},"message":"[SPARK-10180][SQL] JDBC datasource are not processing EqualNullSafe filter\n\nThis PR is followed by https://github.com/apache/spark/pull/8391.\nPrevious PR fixes JDBCRDD to support null-safe equality comparison for JDBC datasource. This PR fixes the problem that it can actually return null as a result of the comparison resulting error as using the value of that comparison.\n\nAuthor: hyukjinkwon <gurwls223@gmail.com>\nAuthor: HyukjinKwon <gurwls223@gmail.com>\n\nCloses #8743 from HyukjinKwon/SPARK-10180.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/94f7a12b3c8e4a6ecd969893e562feb7ffba4c24"},{"sha":"15bd73627e04591fd13667b4838c9098342db965","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"[SPARK-12481][CORE][STREAMING][SQL] Remove usage of Hadoop deprecated APIs and reflection that supported 1.x\n\nRemove use of deprecated Hadoop APIs now that 2.2+ is required\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #10446 from srowen/SPARK-12481.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/15bd73627e04591fd13667b4838c9098342db965"},{"sha":"513e3b092c4f3d58058ff64c861ea35cfec04205","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"[SPARK-12599][MLLIB][SQL] Remove the use of callUDF in MLlib\n\ncallUDF has been deprecated. However, we do not have an alternative for users to specify the output data type without type tags. This pull request introduced a new API for that, and replaces the invocation of the deprecated callUDF with that.\n\nAuthor: Reynold Xin <rxin@databricks.com>\n\nCloses #10547 from rxin/SPARK-12599.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/513e3b092c4f3d58058ff64c861ea35cfec04205"},{"sha":"6c5bbd628aaedb6efb44c15f816fea8fb600decc","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"Revert \"Revert \"[SPARK-12286][SPARK-12290][SPARK-12294][SPARK-12284][SQL] always output UnsafeRow\"\"\n\nThis reverts commit 44ee920fd49d35b421ae562ea99bcc8f2b98ced6.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/6c5bbd628aaedb6efb44c15f816fea8fb600decc"},{"sha":"c3d505602de2fd2361633f90e4fff7e041849e28","author":{"email":"fd68b5404b021a07e5ec5abdeb1b0ffe8f04e45b@hotmail.com","name":"felixcheung"},"message":"[SPARK-12327][SPARKR] fix code for lintr warning for commented code\n\nshivaram\n\nAuthor: felixcheung <felixcheung_m@hotmail.com>\n\nCloses #10408 from felixcheung/rcodecomment.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/c3d505602de2fd2361633f90e4fff7e041849e28"},{"sha":"c82924d564c07e6e6f635b9e263994dedf06268a","author":{"email":"4d9d93d024b8bb6f54163a9abd3ede029ef7e21e@tcs.com","name":"thomastechs"},"message":"[SPARK-12533][SQL] hiveContext.table() throws the wrong exception\n\nAvoiding the the No such table exception and throwing analysis exception as per the bug: SPARK-12533\n\nAuthor: thomastechs <thomas.sebastian@tcs.com>\n\nCloses #10529 from thomastechs/topic-branch.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/c82924d564c07e6e6f635b9e263994dedf06268a"},{"sha":"7b92922f7f7ba4ff398dcbd734e8305ba03da87b","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"Update MimaExcludes now Spark 1.6 is in Maven.\n\nAuthor: Reynold Xin <rxin@databricks.com>\n\nCloses #10561 from rxin/update-mima.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/7b92922f7f7ba4ff398dcbd734e8305ba03da87b"},{"sha":"b8410ff9ce8cef7159a7364272e4c4234c5b474f","author":{"email":"1ac01174d25a69dd02ea3a466537bebdc934f2cf@korea.com","name":"Cazen"},"message":"[SPARK-12537][SQL] Add option to accept quoting of all character backslash quoting mechanism\n\nWe can provides the option to choose JSON parser can be enabled to accept quoting of all character or not.\n\nAuthor: Cazen <Cazen@korea.com>\nAuthor: Cazen Lee <cazen.lee@samsung.com>\nAuthor: Cazen Lee <Cazen@korea.com>\nAuthor: cazen.lee <cazen.lee@samsung.com>\n\nCloses #10497 from Cazen/master.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/b8410ff9ce8cef7159a7364272e4c4234c5b474f"},{"sha":"13dab9c3862cc454094cd9ba7b4504a2d095028f","author":{"email":"6be69bb5cf6cb8dd624e7f174d5aba3c49eb4343@us.ibm.com","name":"Holden Karau"},"message":"[SPARK-12611][SQL][PYSPARK][TESTS] Fix test_infer_schema_to_local\n\nPreviously (when the PR was first created) not specifying b= explicitly was fine (and treated as default null) - instead be explicit about b being None in the test.\n\nAuthor: Holden Karau <holden@us.ibm.com>\n\nCloses #10564 from holdenk/SPARK-12611-fix-test-infer-schema-local.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/13dab9c3862cc454094cd9ba7b4504a2d095028f"},{"sha":"84f8492c1555bf8ab44c9818752278f61768eb16","author":{"email":"122021f0743769ca0bda88e68286824599e80160@gmail.com","name":"Xiu Guo"},"message":"[SPARK-12562][SQL] DataFrame.write.format(text) requires the column name to be called value\n\nAuthor: Xiu Guo <xguo27@gmail.com>\n\nCloses #10515 from xguo27/SPARK-12562.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/84f8492c1555bf8ab44c9818752278f61768eb16"},{"sha":"0d165ec2050aa06aa545d74c8d7c2ff197fa02de","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-12612][PROJECT-INFRA] Add missing Hadoop profiles to dev/run-tests-*.py scripts and dev/deps\n\nThere are a couple of places in the `dev/run-tests-*.py` scripts which deal with Hadoop profiles, but the set of profiles that they handle does not include all Hadoop profiles defined in our POM. Similarly, the `hadoop-2.2` and `hadoop-2.6` profiles were missing from `dev/deps`.\n\nThis patch updates these scripts to include all four Hadoop profiles defined in our POM.\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #10565 from JoshRosen/add-missing-hadoop-profiles-in-test-scripts.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/0d165ec2050aa06aa545d74c8d7c2ff197fa02de"},{"sha":"9fd7a2f0247ed6cea0e8dbcdd2b24f41200b3e24","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-10359][PROJECT-INFRA] Use more random number in dev/test-dependencies.sh; fix version switching\n\nThis patch aims to fix another potential source of flakiness in the `dev/test-dependencies.sh` script.\n\npwendell's original patch and my version used `$(date +%s | tail -c6)` to generate a suffix to use when installing temporary Spark versions into the local Maven cache, but this value only changes once per second and thus is highly collision-prone when concurrent builds launch on AMPLab Jenkins. In order to reduce the potential for conflicts, this patch updates the script to call Python's random number generator instead.\n\nI also fixed a bug in how we captured the original project version; the bug was causing the exit handler code to fail.\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #10558 from JoshRosen/build-dep-tests-round-3.","distinct":true,"url":"https://api.github.com/repos/wmbibera/spark/commits/9fd7a2f0247ed6cea0e8dbcdd2b24f41200b3e24"}]}