{"push_id":984330862,"size":14,"distinct_size":1,"ref":"refs/heads/add-filter-for-innerjoin","head":"4f15778f2cc26baf7b5b07313e6f50e458a400a3","before":"0c14be50ad16f445b8cbaf0cd1df0eaf32a14dcd","commits":[{"sha":"7218c0eba957e0a079a407b79c3a050cce9647b2","author":{"email":"204e86d2224e126835d0a0ef58ab8b5e624f862d@mogujie.com","name":"junhao"},"message":"[SPARK-11627] Add initial input rate limit for spark streaming backpressure mechanism.\n\nhttps://issues.apache.org/jira/browse/SPARK-11627\n\nSpark Streaming backpressure mechanism has no initial input rate limit, it might cause OOM exception.\nIn the firest batch task ,receivers receive data at the maximum speed they can reach,it might exhaust executors memory resources. Add a initial input rate limit value can make sure the Streaming job execute  success in the first batch,then the backpressure mechanism can adjust receiving rate adaptively.\n\nAuthor: junhao <junhao@mogujie.com>\n\nCloses #9593 from junhaoMg/junhao-dev.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/7218c0eba957e0a079a407b79c3a050cce9647b2"},{"sha":"1e1e31e03df14f2e7a9654e640fb2796cf059fe0","author":{"email":"651d9e2ab320d6d21a117141758c2477389f223d@fb.com","name":"Sital Kedia"},"message":"[SPARK-13279] Remove O(n^2) operation from scheduler.\n\nThis commit removes an unnecessary duplicate check in addPendingTask that meant\nthat scheduling a task set took time proportional to (# tasks)^2.\n\nAuthor: Sital Kedia <skedia@fb.com>\n\nCloses #11175 from sitalkedia/fix_stuck_driver.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/1e1e31e03df14f2e7a9654e640fb2796cf059fe0"},{"sha":"04e8afe362f3bf36097688f9574c66002535ac0f","author":{"email":"f070f8f0c50caeda5841963fc7b57e73e59dad56@happy-camper.st","name":"Takuya UESHIN"},"message":"[SPARK-13357][SQL] Use generated projection and ordering for TakeOrderedAndProjectNode\n\n`TakeOrderedAndProjectNode` should use generated projection and ordering like other `LocalNode`s.\n\nAuthor: Takuya UESHIN <ueshin@happy-camper.st>\n\nCloses #11230 from ueshin/issues/SPARK-13357.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/04e8afe362f3bf36097688f9574c66002535ac0f"},{"sha":"a7c74d7563926573c01baf613708a0f105a03e57","author":{"email":"711c73f64afdce07b7e38039a96d2224209e9a6c@chrisaycock.com","name":"Christopher C. Aycock"},"message":"[SPARK-13350][DOCS] Config doc updated to state that PYSPARK_PYTHON's default is \"python2.7\"\n\nAuthor: Christopher C. Aycock <chris@chrisaycock.com>\n\nCloses #11239 from chrisaycock/master.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/a7c74d7563926573c01baf613708a0f105a03e57"},{"sha":"1eac3800087a804c4b58a4af8b65eeb0879b6528","author":{"email":"2676c1e0be9d9df57419d05258d46b7142312de2@hortonworks.com","name":"jerryshao"},"message":"[SPARK-13109][BUILD] Fix SBT publishLocal issue\n\nAdd local ivy repo to the SBT build file to fix this.\n\nScaladoc compile error is fixed.\n\nAuthor: jerryshao <sshao@hortonworks.com>\n\nCloses #11001 from jerryshao/SPARK-13109.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/1eac3800087a804c4b58a4af8b65eeb0879b6528"},{"sha":"97ee85daf68345cf5c3c11ae5bf288cc697bdf9e","author":{"email":"412185dfb2d05d147507face6410e08d48a8c8c1@163.com","name":"shijinkui"},"message":"[SPARK-12953][EXAMPLES] RDDRelation writer set overwrite mode\n\nhttps://issues.apache.org/jira/browse/SPARK-12953\n\nfix error when run RDDRelation.main():\n\"path file:/Users/sjk/pair.parquet already exists\"\n\nSet DataFrameWriter's mode to SaveMode.Overwrite\n\nAuthor: shijinkui <shijinkui666@163.com>\n\nCloses #10864 from shijinkui/set_mode.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/97ee85daf68345cf5c3c11ae5bf288cc697bdf9e"},{"sha":"9451fed52cb8a00c706b582a0b51d8cd832f9350","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[SPARK-13344][TEST] Fix harmless accumulator not found exceptions\n\nSee [JIRA](https://issues.apache.org/jira/browse/SPARK-13344) for more detail. This was caused by #10835.\n\nAuthor: Andrew Or <andrew@databricks.com>\n\nCloses #11222 from andrewor14/fix-test-accum-exceptions.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/9451fed52cb8a00c706b582a0b51d8cd832f9350"},{"sha":"0088b252bf56d391025a19b70af03f3ce6d7574c","author":{"email":"9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","name":"Xiangrui Meng"},"message":"[MINOR][MLLIB] fix mllib compile warnings\n\nThis PR fixes some warnings found by `build/sbt mllib/test:compile`.\n\nAuthor: Xiangrui Meng <meng@databricks.com>\n\nCloses #11227 from mengxr/fix-mllib-warnings-201602.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/0088b252bf56d391025a19b70af03f3ce6d7574c"},{"sha":"b84404865b90fc07858a8b28c2a7028f96517167","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"[SPARK-13324][CORE][BUILD] Update plugin, test, example dependencies for 2.x\n\nPhase 1: update plugin versions, test dependencies, some example and third-party versions\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #11206 from srowen/SPARK-13324.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/b84404865b90fc07858a8b28c2a7028f96517167"},{"sha":"892b2dd6dd00d2088c75ab3c8443e8b3e44e5803","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"Add github pull request template","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/892b2dd6dd00d2088c75ab3c8443e8b3e44e5803"},{"sha":"78562535feb6e214520b29e0bbdd4b1302f01e93","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"[SPARK-13371][CORE][STRING] TaskSetManager.dequeueSpeculativeTask compares Option and String directly.\n\n## What changes were proposed in this pull request?\n\nFix some comparisons between unequal types that cause IJ warnings and in at least one case a likely bug (TaskSetManager)\n\n## How was the this patch tested?\n\nRunning Jenkins tests\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #11253 from srowen/SPARK-13371.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/78562535feb6e214520b29e0bbdd4b1302f01e93"},{"sha":"26f38bb83c423e512955ca25775914dae7e5bbf0","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-13351][SQL] fix column pruning on Expand\n\nCurrently, the columns in projects of Expand that are not used by Aggregate are not pruned, this PR fix that.\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #11225 from davies/fix_pruning_expand.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/26f38bb83c423e512955ca25775914dae7e5bbf0"},{"sha":"95e1ab223e87fc216f3256d404fe3be50d111a9d","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-13237] [SQL] generated broadcast outer join\n\nThis PR support codegen for broadcast outer join.\n\nIn order to reduce the duplicated codes, this PR merge HashJoin and HashOuterJoin together (also BroadcastHashJoin and BroadcastHashOuterJoin).\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #11130 from davies/gen_out.","distinct":false,"url":"https://api.github.com/repos/viirya/spark-1/commits/95e1ab223e87fc216f3256d404fe3be50d111a9d"},{"sha":"4f15778f2cc26baf7b5b07313e6f50e458a400a3","author":{"email":"d24118b4297e1ecf0c990d6935f5f9e6e4fd7701@gmail.com","name":"Liang-Chi Hsieh"},"message":"Merge remote-tracking branch 'upstream/master' into add-filter-for-innerjoin\n\nConflicts:\n\tsql/core/src/main/scala/org/apache/spark/sql/execution/joins/BroadcastHashJoin.scala","distinct":true,"url":"https://api.github.com/repos/viirya/spark-1/commits/4f15778f2cc26baf7b5b07313e6f50e458a400a3"}]}