{"push_id":3135836701,"size":1,"distinct_size":1,"ref":"refs/heads/dse-2.4","head":"002a05c7b6f9155b138d11e60e73e6ec5567edca","before":"b7c740cba9dba753ab5bf3e75033a1174174000a","commits":[{"sha":"002a05c7b6f9155b138d11e60e73e6ec5567edca","author":{"name":"Russell Spitzer","email":"b4f99bbaf9153e145146d8bed3992790fe0edce1@gmail.com"},"message":"Update Versions for Spark 2.4\n\nUpgrade Py4j To the Correct Version\n\nSpark 2.4 Pyspark Compatiblity\n\nSeveral version bumps of associated libraries. Also includes\nconverting the current subprocess.py and associated PythonJob\nto use an authentication token when starting Pyspark. The method\nused for generating the token is the same as inside native Spark. The\ntoken is passed via environment variable from the PythonJob class to\nthe subprocess.py process which starts up the python interpreter.\n\nFix Tests\n\nSwitches warehouse directories per test job since the \"DROP TABLE\"\ndoesn't seem to work in SPARK 2.4 like it did in Spark 2.2. Extend\nthe timeout on the python Job spec.","distinct":true,"url":"https://api.github.com/repos/riptano/spark-jobserver/commits/002a05c7b6f9155b138d11e60e73e6ec5567edca"}]}
{"actor":{"display_login":"RussellSpitzer"}}