{"push_id":1226990642,"size":10,"distinct_size":4,"ref":"refs/heads/jenkins","head":"a4a6b26434492a82c45cdc1cb69f3c7a33f262ea","before":"fd01d0dd61b26075c6e5e4f73dc600917215f57d","commits":[{"sha":"d1d5069aa3744d46abd3889abab5f15e9067382a","author":{"name":"Wesley Tang","email":"c52c3b098164201233f329aa2b18b552b34b71d6@mininglamp.com"},"message":"[SPARK-16664][SQL] Fix persist call on Data frames with more than 200…\n\n## What changes were proposed in this pull request?\n\nf12f11e578169b47e3f8b18b299948c0670ba585 introduced this bug, missed foreach as map\n\n## How was this patch tested?\n\nTest added\n\nAuthor: Wesley Tang <tangmingjun@mininglamp.com>\n\nCloses #14324 from breakdawn/master.","distinct":false,"url":"https://api.github.com/repos/cocoatomo/spark/commits/d1d5069aa3744d46abd3889abab5f15e9067382a"},{"sha":"0557a45452f6e73877e5ec972110825ce8f3fbc5","author":{"name":"Yanbo Liang","email":"b6929798b4e4fba75014af8265904a7818902ec7@gmail.com"},"message":"[SPARK-16750][ML] Fix GaussianMixture training failed due to feature column type mistake\n\n## What changes were proposed in this pull request?\nML ```GaussianMixture``` training failed due to feature column type mistake. The feature column type should be ```ml.linalg.VectorUDT``` but got ```mllib.linalg.VectorUDT``` by mistake.\nSee [SPARK-16750](https://issues.apache.org/jira/browse/SPARK-16750) for how to reproduce this bug.\nWhy the unit tests did not complain this errors? Because some estimators/transformers missed calling ```transformSchema(dataset.schema)``` firstly during ```fit``` or ```transform```. I will also add this function to all estimators/transformers who missed in this PR.\n\n## How was this patch tested?\nNo new tests, should pass existing ones.\n\nAuthor: Yanbo Liang <ybliang8@gmail.com>\n\nCloses #14378 from yanboliang/spark-16750.","distinct":false,"url":"https://api.github.com/repos/cocoatomo/spark/commits/0557a45452f6e73877e5ec972110825ce8f3fbc5"},{"sha":"04a2c072d94874f3f7ae9dd94c026e8826a75ccd","author":{"name":"Adam Roberts","email":"ac6c9ba1da70de03b556cc2f8b9c0fac7b1e271e@uk.ibm.com"},"message":"[SPARK-16751] Upgrade derby to 10.12.1.1\n\n## What changes were proposed in this pull request?\n\nVersion of derby upgraded based on important security info at VersionEye. Test scope added so we don't include it in our final package anyway. NB: I think this should be backported to all previous releases as it is a security problem https://www.versioneye.com/java/org.apache.derby:derby/10.11.1.1\n\nThe CVE number is 2015-1832. I also suggest we add a SECURITY tag for JIRAs\n\n## How was this patch tested?\nExisting tests with the change making sure that we see no new failures. I checked derby 10.12.x and not derby 10.11.x is downloaded to our ~/.m2 folder.\n\nI then used dev/make-distribution.sh and checked the dist/jars folder for Spark 2.0: no derby jar is present.\n\nI don't know if this would also remove it from the assembly jar in our 1.x branches.\n\nAuthor: Adam Roberts <aroberts@uk.ibm.com>\n\nCloses #14379 from a-roberts/patch-4.","distinct":false,"url":"https://api.github.com/repos/cocoatomo/spark/commits/04a2c072d94874f3f7ae9dd94c026e8826a75ccd"},{"sha":"266b92faffb66af24d8ed2725beb80770a2d91f8","author":{"name":"Michael Gummelt","email":"997b1eeb9667009a1fe95939cfe9ef99c4f83395@mesosphere.io"},"message":"[SPARK-16637] Unified containerizer\n\n## What changes were proposed in this pull request?\n\nNew config var: spark.mesos.docker.containerizer={\"mesos\",\"docker\" (default)}\n\nThis adds support for running docker containers via the Mesos unified containerizer: http://mesos.apache.org/documentation/latest/container-image/\n\nThe benefit is losing the dependency on `dockerd`, and all the costs which it incurs.\n\nI've also updated the supported Mesos version to 0.28.2 for support of the required protobufs.\n\nThis is blocked on: https://github.com/apache/spark/pull/14167\n\n## How was this patch tested?\n\n- manually testing jobs submitted with both \"mesos\" and \"docker\" settings for the new config var.\n- spark/mesos integration test suite\n\nAuthor: Michael Gummelt <mgummelt@mesosphere.io>\n\nCloses #14275 from mgummelt/unified-containerizer.","distinct":false,"url":"https://api.github.com/repos/cocoatomo/spark/commits/266b92faffb66af24d8ed2725beb80770a2d91f8"},{"sha":"2c15323ad026da64caa68787c5d103a8595f63a0","author":{"name":"Sun Dapeng","email":"475e951cfcbbfda22e3cd6b3aae5dd506f1c7328@apache.org"},"message":"[SPARK-16761][DOC][ML] Fix doc link in docs/ml-guide.md\n\n## What changes were proposed in this pull request?\n\nFix the link at http://spark.apache.org/docs/latest/ml-guide.html.\n\n## How was this patch tested?\n\nNone\n\nAuthor: Sun Dapeng <sdp@apache.org>\n\nCloses #14386 from sundapeng/doclink.","distinct":false,"url":"https://api.github.com/repos/cocoatomo/spark/commits/2c15323ad026da64caa68787c5d103a8595f63a0"},{"sha":"2182e4322da6ba732f99ae75dce00f76f1cdc4d9","author":{"name":"Nicholas Chammas","email":"3a05fc0c001acadf8f7c4ad23a983345f7ce437d@gmail.com"},"message":"[SPARK-16772][PYTHON][DOCS] Restore \"datatype string\" to Python API docstrings\n\n## What changes were proposed in this pull request?\n\nThis PR corrects [an error made in an earlier PR](https://github.com/apache/spark/pull/14393/files#r72843069).\n\n## How was this patch tested?\n\n```sh\n$ ./dev/lint-python\nPEP8 checks passed.\nrm -rf _build/*\npydoc checks passed.\n```\n\nI also built the docs and confirmed that they looked good in my browser.\n\nAuthor: Nicholas Chammas <nicholas.chammas@gmail.com>\n\nCloses #14408 from nchammas/SPARK-16772.","distinct":false,"url":"https://api.github.com/repos/cocoatomo/spark/commits/2182e4322da6ba732f99ae75dce00f76f1cdc4d9"},{"sha":"bfffb577b8b91f4d71d6458c44436c64cdce1a52","author":{"name":"cocoatomo","email":"e881feb057d698c90e78872ba5aa0012023eb66a@gmail.com"},"message":"Log Empty exception","distinct":true,"url":"https://api.github.com/repos/cocoatomo/spark/commits/bfffb577b8b91f4d71d6458c44436c64cdce1a52"},{"sha":"f82e3951e313a11264b800a13abaf823bf398adf","author":{"name":"cocoatomo","email":"e881feb057d698c90e78872ba5aa0012023eb66a@gmail.com"},"message":"Add log to display contents of task_queue","distinct":true,"url":"https://api.github.com/repos/cocoatomo/spark/commits/f82e3951e313a11264b800a13abaf823bf398adf"},{"sha":"fba206b4623a980ea966a8384a5664d752e1bb8f","author":{"name":"cocoatomo","email":"e881feb057d698c90e78872ba5aa0012023eb66a@gmail.com"},"message":"Refine logging","distinct":true,"url":"https://api.github.com/repos/cocoatomo/spark/commits/fba206b4623a980ea966a8384a5664d752e1bb8f"},{"sha":"a4a6b26434492a82c45cdc1cb69f3c7a33f262ea","author":{"name":"cocoatomo","email":"e881feb057d698c90e78872ba5aa0012023eb66a@gmail.com"},"message":"Log dequeued item","distinct":true,"url":"https://api.github.com/repos/cocoatomo/spark/commits/a4a6b26434492a82c45cdc1cb69f3c7a33f262ea"}]}
{"actor":{"display_login":"cocoatomo"}}