{"push_id":1074690403,"size":6,"distinct_size":6,"ref":"refs/heads/master","head":"6f1ec1f2670cd55bc852a810ca9d5c6a2651a9f2","before":"3ae25f244bd471ef77002c703f2cc7ed6b524f11","commits":[{"sha":"4514aebd1e807a665c270bfdc3f1127b3a1da898","author":{"email":"0da04896db04dd2393029a4b0c77df7858a20dea@gmail.com","name":"Lianhui Wang"},"message":"[SPARK-14705][YARN] support Multiple FileSystem for YARN STAGING DIR\n\n## What changes were proposed in this pull request?\nIn SPARK-13063, It makes the SPARK YARN STAGING DIR as configurable. But it only support default FileSystem. If there are many clusters, It can be different FileSystem for different cluster in our spark.\n\n## How was this patch tested?\nI have tested it successfully with following commands:\nMASTER=yarn-client ./bin/spark-shell --conf spark.yarn.stagingDir=hdfs:namenode2/temp\n$SPARK_HOME/bin/spark-submit --conf spark.yarn.stagingDir=hdfs:namenode2/temp\n\ncc tgravescs vanzin andrewor14\n\nAuthor: Lianhui Wang <lianhuiwang09@gmail.com>\n\nCloses #12473 from lianhuiwang/SPARK-14705.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/4514aebd1e807a665c270bfdc3f1127b3a1da898"},{"sha":"8eedf0b553180d0e958b0fb49bc2fee81658495c","author":{"email":"3f27eab2afd49386f0ac811afb0bc245aa92c0fa@intel.com","name":"Sun Rui"},"message":"[SPARK-13905][SPARKR] Change signature of as.data.frame() to be consistent with the R base package.\n\n## What changes were proposed in this pull request?\n\nChange the signature of as.data.frame() to be consistent with that in the R base package to meet R user's convention.\n\n## How was this patch tested?\ndev/lint-r\nSparkR unit tests\n\nAuthor: Sun Rui <rui.sun@intel.com>\n\nCloses #11811 from sun-rui/SPARK-13905.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/8eedf0b553180d0e958b0fb49bc2fee81658495c"},{"sha":"78b38109ed2fc20e97f9a968185d0c02ef83aa42","author":{"email":"00d7a42e7227da37af994b379e3eb0eed5cbdaa7@apache.org","name":"Luciano Resende"},"message":"[SPARK-13419] [SQL] Update SubquerySuite to use checkAnswer for validation\n\n## What changes were proposed in this pull request?\n\nChange SubquerySuite to validate test results utilizing checkAnswer helper method\n\n## How was this patch tested?\n\nExisting tests\n\nAuthor: Luciano Resende <lresende@apache.org>\n\nCloses #12269 from lresende/SPARK-13419.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/78b38109ed2fc20e97f9a968185d0c02ef83aa42"},{"sha":"85d759ca3aebb7d60b963207dcada83c75502e52","author":{"email":"563f5923eae9a92c8a3f34a26b67fa348a303ed1@databricks.com","name":"Wenchen Fan"},"message":"[SPARK-14704][CORE] create accumulators in TaskMetrics\n\n## What changes were proposed in this pull request?\n\nBefore this PR, we create accumulators at driver side(and register them) and send them to executor side, then we create `TaskMetrics` with these accumulators at executor side.\nAfter this PR, we will create `TaskMetrics` at driver side and send it to executor side, so that we can create accumulators inside `TaskMetrics` directly, which is cleaner.\n\n## How was this patch tested?\n\nexisting tests.\n\nAuthor: Wenchen Fan <wenchen@databricks.com>\n\nCloses #12472 from cloud-fan/acc.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/85d759ca3aebb7d60b963207dcada83c75502e52"},{"sha":"856bc465d53ccfdfda75c82c85d7f318a5158088","author":{"email":"563f5923eae9a92c8a3f34a26b67fa348a303ed1@databricks.com","name":"Wenchen Fan"},"message":"[SPARK-14600] [SQL] Push predicates through Expand\n\n## What changes were proposed in this pull request?\n\nhttps://issues.apache.org/jira/browse/SPARK-14600\n\nThis PR makes `Expand.output` have different attributes from the grouping attributes produced by the underlying `Project`, as they have different meaning, so that we can safely push down filter through `Expand`\n\n## How was this patch tested?\n\nexisting tests.\n\nAuthor: Wenchen Fan <wenchen@databricks.com>\n\nCloses #12496 from cloud-fan/expand.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/856bc465d53ccfdfda75c82c85d7f318a5158088"},{"sha":"6f1ec1f2670cd55bc852a810ca9d5c6a2651a9f2","author":{"email":"6ff48b33cbb828151035af58a92f18a39f1d1036@apache.org","name":"Dongjoon Hyun"},"message":"[MINOR] [SQL] Re-enable `explode()` and `json_tuple()` testcases in ExpressionToSQLSuite\n\n## What changes were proposed in this pull request?\n\nSince [SPARK-12719: SQL Generation supports for generators](https://issues.apache.org/jira/browse/SPARK-12719) was resolved, this PR enables the related testcases: `explode()` and `json_tuple()`.\n\n## How was this patch tested?\n\nPass the Jenkins tests (with re-enabled test cases).\n\nAuthor: Dongjoon Hyun <dongjoon@apache.org>\n\nCloses #12329 from dongjoon-hyun/minor_enable_testcases.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/6f1ec1f2670cd55bc852a810ca9d5c6a2651a9f2"}]}