{"push_id":2417802624,"size":1,"distinct_size":1,"ref":"refs/heads/branch-2.3","head":"c854b6ca7ba4dc33138c12ba4606ff8fbe82aef2","before":"2f82c037d90114705c0d0bd0bd7f82215aecfe3b","commits":[{"sha":"c854b6ca7ba4dc33138c12ba4606ff8fbe82aef2","author":{"name":"hyukjinkwon","email":"4c114bf3676ebcdb1616a11ca478d9181f4025da@gmail.com"},"message":"[SPARK-23691][PYTHON][BRANCH-2.3] Use sql_conf util in PySpark tests where possible\n\n## What changes were proposed in this pull request?\n\nThis PR backports https://github.com/apache/spark/pull/20830 to reduce the diff against master and restore the default value back in PySpark tests.\n\nhttps://github.com/apache/spark/commit/d6632d185e147fcbe6724545488ad80dce20277e added an useful util. This backport extracts and brings this util:\n\n```python\ncontextmanager\ndef sql_conf(self, pairs):\n    ...\n```\n\nto allow configuration set/unset within a block:\n\n```python\nwith self.sql_conf({\"spark.blah.blah.blah\", \"blah\"})\n    # test codes\n```\n\nThis PR proposes to use this util where possible in PySpark tests.\n\nNote that there look already few places affecting tests without restoring the original value back in unittest classes.\n\n## How was this patch tested?\n\nLikewise, manually tested via:\n\n```\n./run-tests --modules=pyspark-sql --python-executables=python2\n./run-tests --modules=pyspark-sql --python-executables=python3\n```\n\nAuthor: hyukjinkwon <gurwls223@gmail.com>\n\nCloses #20863 from HyukjinKwon/backport-20830.","distinct":true,"url":"https://api.github.com/repos/zzcclp/spark/commits/c854b6ca7ba4dc33138c12ba4606ff8fbe82aef2"}]}
{"actor":{"display_login":"zzcclp"}}