{"push_id":2958801996,"size":1,"distinct_size":1,"ref":"refs/heads/branch-2.4","head":"b6e4aca0be7f3b863c326063a3c02aa8a1c266a3","before":"3e776d73b87b8dd7cda603e409dbc4eb258748bb","commits":[{"sha":"b6e4aca0be7f3b863c326063a3c02aa8a1c266a3","author":{"name":"hyukjinkwon","email":"2680965ad5aae29275c8fb10150cb10f5554e78b@apache.org"},"message":"[SPARK-25700][SQL][BRANCH-2.4] Partially revert append mode support in Data Source V2\n\n## What changes were proposed in this pull request?\n\nThis PR proposes to partially revert https://github.com/apache/spark/commit/5fef6e3513d6023a837c427d183006d153c7102b so that it does make a readsupport and read schema when it writes in branch 2-4 since it's too breaking change.\n\nhttps://github.com/apache/spark/commit/5fef6e3513d6023a837c427d183006d153c7102b happened to create a readsupport in write path, which ended up with reading schema from readsupport at write path.\n\nFor instance, this breaks `spark.range(1).format(\"source\").write.save(\"non-existent-path\")` case since there's no way to read the schema from \"non-existent-path\".\n\nSee also https://github.com/apache/spark/pull/22009#discussion_r223982672\nSee also https://github.com/apache/spark/pull/22688\nSee also http://apache-spark-developers-list.1001551.n3.nabble.com/Possible-bug-in-DatasourceV2-td25343.html\n\n## How was this patch tested?\n\nUnit test and manual tests.\n\nCloses #22697 from HyukjinKwon/append-revert-2.4.\n\nAuthored-by: hyukjinkwon <gurwls223@apache.org>\nSigned-off-by: Wenchen Fan <wenchen@databricks.com>","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/b6e4aca0be7f3b863c326063a3c02aa8a1c266a3"}]}
{"actor":{"display_login":"zzcclp"}}