{"push_id":950092436,"size":5,"distinct_size":5,"ref":"refs/heads/master","head":"6743de3a98e3f0d0e6064ca1872fa88c3aeaa143","before":"fdcc3512f7b45e5b067fc26cb05146f79c4a5177","commits":[{"sha":"b66afdeb5253913d916dcf159aaed4ffdc15fd4b","author":{"email":"6be69bb5cf6cb8dd624e7f174d5aba3c49eb4343@us.ibm.com","name":"Holden Karau"},"message":"[SPARK-11922][PYSPARK][ML] Python api for ml.feature.quantile discretizer\n\nAdd Python API for ml.feature.QuantileDiscretizer.\n\nOne open question: Do we want to do this stuff to re-use the java model, create a new model, or use a different wrapper around the java model.\ncc brkyvz & mengxr\n\nAuthor: Holden Karau <holden@us.ibm.com>\n\nCloses #10085 from holdenk/SPARK-11937-SPARK-11922-Python-API-for-ml.feature.QuantileDiscretizer.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/b66afdeb5253913d916dcf159aaed4ffdc15fd4b"},{"sha":"ae47ba718a280fc12720a71b981c38dbe647f35b","author":{"email":"7853928d03425cf3be35be2fa0c5b99641435d26@gmail.com","name":"Xusen Yin"},"message":"[SPARK-12834] Change ser/de of JavaArray and JavaList\n\nhttps://issues.apache.org/jira/browse/SPARK-12834\n\nWe use `SerDe.dumps()` to serialize `JavaArray` and `JavaList` in `PythonMLLibAPI`, then deserialize them with `PickleSerializer` in Python side. However, there is no need to transform them in such an inefficient way. Instead of it, we can use type conversion to convert them, e.g. `list(JavaArray)` or `list(JavaList)`. What's more, there is an issue to Ser/De Scala Array as I said in https://issues.apache.org/jira/browse/SPARK-12780\n\nAuthor: Xusen Yin <yinxusen@gmail.com>\n\nCloses #10772 from yinxusen/SPARK-12834.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/ae47ba718a280fc12720a71b981c38dbe647f35b"},{"sha":"27c910f7f29087d1ac216d4933d641d6515fd6ad","author":{"email":"9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","name":"Xiangrui Meng"},"message":"[SPARK-10086][MLLIB][STREAMING][PYSPARK] ignore StreamingKMeans test in PySpark for now\n\nI saw several failures from recent PR builds, e.g., https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50015/consoleFull. This PR marks the test as ignored and we will fix the flakyness in SPARK-10086.\n\ngliptak Do you know why the test failure didn't show up in the Jenkins \"Test Result\"?\n\ncc: jkbradley\n\nAuthor: Xiangrui Meng <meng@databricks.com>\n\nCloses #10909 from mengxr/SPARK-10086.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/27c910f7f29087d1ac216d4933d641d6515fd6ad"},{"sha":"d54cfed5a6953a9ce2b9de2f31ee2d673cb5cc62","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"[SQL][MINOR] A few minor tweaks to CSV reader.\n\nThis pull request simply fixes a few minor coding style issues in csv, as I was reviewing the change post-hoc.\n\nAuthor: Reynold Xin <rxin@databricks.com>\n\nCloses #10919 from rxin/csv-minor.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/d54cfed5a6953a9ce2b9de2f31ee2d673cb5cc62"},{"sha":"6743de3a98e3f0d0e6064ca1872fa88c3aeaa143","author":{"email":"563f5923eae9a92c8a3f34a26b67fa348a303ed1@databricks.com","name":"Wenchen Fan"},"message":"[SPARK-12937][SQL] bloom filter serialization\n\nThis PR adds serialization support for BloomFilter.\n\nA version number is added to version the serialized binary format.\n\nAuthor: Wenchen Fan <wenchen@databricks.com>\n\nCloses #10920 from cloud-fan/bloom-filter.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/6743de3a98e3f0d0e6064ca1872fa88c3aeaa143"}]}