{"push_id":1120008636,"size":1,"distinct_size":1,"ref":"refs/heads/branch-2.0","head":"d1b5df83d789510340e20a98bee8fd3e0e55b8f8","before":"62e5158f167425b9565a2b01fc494e593c57cae3","commits":[{"sha":"d1b5df83d789510340e20a98bee8fd3e0e55b8f8","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-15392][SQL] fix default value of size estimation of logical plan\n\n## What changes were proposed in this pull request?\n\nWe use autoBroadcastJoinThreshold + 1L as the default value of size estimation, that is not good in 2.0, because we will calculate the size based on size of schema, then the estimation could be less than autoBroadcastJoinThreshold if you have an SELECT on top of an DataFrame created from RDD.\n\nThis PR change the default value to Long.MaxValue.\n\n## How was this patch tested?\n\nAdded regression tests.\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #13183 from davies/fix_default_size.\n\n(cherry picked from commit 5ccecc078aa757d3f1f6632aa6df5659490f602f)\nSigned-off-by: Andrew Or <andrew@databricks.com>","distinct":true,"url":"https://api.github.com/repos/apache/spark/commits/d1b5df83d789510340e20a98bee8fd3e0e55b8f8"}]}