{"push_id":2647460648,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"22daeba59b3ffaccafc9ff4b521abc265d0e58dd","before":"270a9a3cac25f3e799460320d0fc94ccd7ecfaea","commits":[{"sha":"22daeba59b3ffaccafc9ff4b521abc265d0e58dd","author":{"name":"Ryan Blue","email":"4c9a82ce72ca2519f38d0af0abbb4cecb9fceca9@apache.org"},"message":"[SPARK-24478][SQL] Move projection and filter push down to physical conversion\n\n## What changes were proposed in this pull request?\n\nThis removes the v2 optimizer rule for push-down and instead pushes filters and required columns when converting to a physical plan, as suggested by marmbrus. This makes the v2 relation cleaner because the output and filters do not change in the logical plan.\n\nA side-effect of this change is that the stats from the logical (optimized) plan no longer reflect pushed filters and projection. This is a temporary state, until the planner gathers stats from the physical plan instead. An alternative to this approach is https://github.com/rdblue/spark/commit/9d3a11e68bca6c5a56a2be47fb09395350362ac5.\n\nThe first commit was proposed in #21262. This PR replaces #21262.\n\n## How was this patch tested?\n\nExisting tests.\n\nAuthor: Ryan Blue <blue@apache.org>\n\nCloses #21503 from rdblue/SPARK-24478-move-push-down-to-physical-conversion.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/22daeba59b3ffaccafc9ff4b521abc265d0e58dd"}]}
{"actor":{"display_login":"zzcclp"}}