{"push_id":1439182511,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"01a7d33d0851d82fd1bb477a58d9925fe8d727d8","before":"246012859f0ed5248809a2e00e8355fbdaa8beb5","commits":[{"sha":"01a7d33d0851d82fd1bb477a58d9925fe8d727d8","author":{"name":"Wenchen Fan","email":"51df79715bab6f96b68cf2b8813ef1aaa5547bdb@databricks.com"},"message":"[SPARK-18711][SQL] should disable subexpression elimination for LambdaVariable\n\n## What changes were proposed in this pull request?\n\nThis is kind of a long-standing bug, it's hidden until https://github.com/apache/spark/pull/15780 , which may add `AssertNotNull` on top of `LambdaVariable` and thus enables subexpression elimination.\n\nHowever, subexpression elimination will evaluate the common expressions at the beginning, which is invalid for `LambdaVariable`. `LambdaVariable` usually represents loop variable, which can't be evaluated ahead of the loop.\n\nThis PR skips expressions containing `LambdaVariable` when doing subexpression elimination.\n\n## How was this patch tested?\n\nupdated test in `DatasetAggregatorSuite`\n\nAuthor: Wenchen Fan <wenchen@databricks.com>\n\nCloses #16143 from cloud-fan/aggregator.","distinct":true,"url":"https://api.github.com/repos/apache/spark/commits/01a7d33d0851d82fd1bb477a58d9925fe8d727d8"}]}
{"actor":{"display_login":"asfgit"}}