{"push_id":1227410393,"size":5,"distinct_size":5,"ref":"refs/heads/master","head":"a6290e51e402e8434d6207d553db1f551e714fde","before":"2c15323ad026da64caa68787c5d103a8595f63a0","commits":[{"sha":"2182e4322da6ba732f99ae75dce00f76f1cdc4d9","author":{"name":"Nicholas Chammas","email":"3a05fc0c001acadf8f7c4ad23a983345f7ce437d@gmail.com"},"message":"[SPARK-16772][PYTHON][DOCS] Restore \"datatype string\" to Python API docstrings\n\n## What changes were proposed in this pull request?\n\nThis PR corrects [an error made in an earlier PR](https://github.com/apache/spark/pull/14393/files#r72843069).\n\n## How was this patch tested?\n\n```sh\n$ ./dev/lint-python\nPEP8 checks passed.\nrm -rf _build/*\npydoc checks passed.\n```\n\nI also built the docs and confirmed that they looked good in my browser.\n\nAuthor: Nicholas Chammas <nicholas.chammas@gmail.com>\n\nCloses #14408 from nchammas/SPARK-16772.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/2182e4322da6ba732f99ae75dce00f76f1cdc4d9"},{"sha":"bbc247548ac6faeca15afc05c266cee37ef13416","author":{"name":"Tathagata Das","email":"58b3b6773dfe925407947ae07f6b206d48277ab4@gmail.com"},"message":"[SPARK-16748][SQL] SparkExceptions during planning should not wrapped in TreeNodeException\n\n## What changes were proposed in this pull request?\nWe do not want SparkExceptions from job failures in the planning phase to create TreeNodeException. Hence do not wrap SparkException in TreeNodeException.\n\n## How was this patch tested?\nNew unit test\n\nAuthor: Tathagata Das <tathagata.das1565@gmail.com>\n\nCloses #14395 from tdas/SPARK-16748.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/bbc247548ac6faeca15afc05c266cee37ef13416"},{"sha":"0dc4310b470c7e4355c0da67ca3373c3013cc9dd","author":{"name":"Sean Owen","email":"4c59f357315334980589bde1049040bf6de6532c@cloudera.com"},"message":"[SPARK-16694][CORE] Use for/foreach rather than map for Unit expressions whose side effects are required\n\n## What changes were proposed in this pull request?\n\nUse foreach/for instead of map where operation requires execution of body, not actually defining a transformation\n\n## How was this patch tested?\n\nJenkins\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #14332 from srowen/SPARK-16694.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/0dc4310b470c7e4355c0da67ca3373c3013cc9dd"},{"sha":"bce354c1d4e2b97b1159913085e9883a26bc605a","author":{"name":"WeichenXu","email":"7a440c883b23bc43b7a6fdb423cbfd8e75175a83@outlook.com"},"message":"[SPARK-16696][ML][MLLIB] destroy KMeans bcNewCenters when loop finished and update code where should release unused broadcast/RDD in proper time\n\n## What changes were proposed in this pull request?\n\nupdate unused broadcast in KMeans/Word2Vec,\nuse destroy(false) to release memory in time.\n\nand several place destroy() update to destroy(false) so that it will be async-called,\nit will better than blocking called.\n\nand update bcNewCenters in KMeans to make it destroy in correct time.\nI use a list to store all historical `bcNewCenters` generated in each loop iteration and delay them to release at the end of loop.\n\nfix TODO in `BisectingKMeans.run` \"unpersist old indices\",\nImplements the pattern \"persist current step RDD, and unpersist previous one\" in the loop iteration.\n\n## How was this patch tested?\n\nExisting tests.\n\nAuthor: WeichenXu <WeichenXu123@outlook.com>\n\nCloses #14333 from WeichenXu123/broadvar_unpersist_to_destroy.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/bce354c1d4e2b97b1159913085e9883a26bc605a"},{"sha":"a6290e51e402e8434d6207d553db1f551e714fde","author":{"name":"Bryan Cutler","email":"62bf89cc0e70e22c1fc5a3d8c3b77c0895eb33c3@gmail.com"},"message":"[SPARK-16800][EXAMPLES][ML] Fix Java examples that fail to run due to exception\n\n## What changes were proposed in this pull request?\nSome Java examples are using mllib.linalg.Vectors instead of ml.linalg.Vectors and causes an exception when run.  Also there are some Java examples that incorrectly specify data types in the schema, also causing an exception.\n\n## How was this patch tested?\nRan corrected examples locally\n\nAuthor: Bryan Cutler <cutlerb@gmail.com>\n\nCloses #14405 from BryanCutler/java-examples-ml.Vectors-fix-SPARK-16800.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/a6290e51e402e8434d6207d553db1f551e714fde"}]}
{"actor":{"display_login":"zzcclp"}}