{"push_id":1150949845,"size":3,"distinct_size":3,"ref":"refs/heads/master","head":"921fa40b14082bfd1094fa49fb3b0c46a79c1aaa","before":"4e8ac6edd5808ca8245b39d804c6d4f5ea9d0d36","commits":[{"sha":"afbe35cf5b272991b4986e551b42d9201c3862c3","author":{"name":"Wenchen Fan","email":"51df79715bab6f96b68cf2b8813ef1aaa5547bdb@databricks.com"},"message":"[SPARK-14670] [SQL] allow updating driver side sql metrics\n\n## What changes were proposed in this pull request?\n\nOn the SparkUI right now we have this SQLTab that displays accumulator values per operator. However, it only displays metrics updated on the executors, not on the driver. It is useful to also include driver metrics, e.g. broadcast time.\n\nThis is a different version from https://github.com/apache/spark/pull/12427. This PR sends driver side accumulator updates right after the updating happens, not at the end of execution, by a new event.\n\n## How was this patch tested?\n\nnew test in `SQLListenerSuite`\n\n![qq20160606-0](https://cloud.githubusercontent.com/assets/3182036/15841418/0eb137da-2c06-11e6-9068-5694eeb78530.png)\n\nAuthor: Wenchen Fan <wenchen@databricks.com>\n\nCloses #13189 from cloud-fan/metrics.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/afbe35cf5b272991b4986e551b42d9201c3862c3"},{"sha":"d5807def10c21e145163dc1e34d38258dda73ebf","author":{"name":"Sandeep Singh","email":"69043e619d79bcf4ae068e5b131d66c33e73727d@techaddict.me"},"message":"[MINOR][DOC] In Dataset docs, remove self link to Dataset and add link to Column\n\n## What changes were proposed in this pull request?\nDocumentation Fix\n\n## How was this patch tested?\n\nAuthor: Sandeep Singh <sandeep@techaddict.me>\n\nCloses #13567 from techaddict/minor-4.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/d5807def10c21e145163dc1e34d38258dda73ebf"},{"sha":"921fa40b14082bfd1094fa49fb3b0c46a79c1aaa","author":{"name":"Josh Rosen","email":"1fa93d1db1fb7c1c51f2467ef55c960ec1b64919@databricks.com"},"message":"[SPARK-12712] Fix failure in ./dev/test-dependencies when run against empty .m2 cache\n\nThis patch fixes a bug in `./dev/test-dependencies.sh` which caused spurious failures when the script was run on a machine with an empty `.m2` cache. The problem was that extra log output from the dependency download was conflicting with the grep / regex used to identify the classpath in the Maven output. This patch fixes this issue by adjusting the regex pattern.\n\nTested manually with the following reproduction of the bug:\n\n```\nrm -rf ~/.m2/repository/org/apache/commons/\n./dev/test-dependencies.sh\n```\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #13568 from JoshRosen/SPARK-12712.","distinct":true,"url":"https://api.github.com/repos/ueshin/apache-spark/commits/921fa40b14082bfd1094fa49fb3b0c46a79c1aaa"}]}
{"actor":{"display_login":"ueshin"}}