title: Spark py4j.protocol.Py4JJavaError: An error occurred while calling o718.showString
body: <p>I am new to spark. I am running python API on Spark(pySPark) to build models on cloudera cluster.</p>
  
  <p>I created a batch file to submit the job. The job runs successfully except for the last step of displaying the result of the dataframe - '<code>step3_final.show()</code>', it throws an error.</p>
  
  <p>PFB the error message, that I received in the logs </p>
  
  <pre><code>step3_final.show(6)
    File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p1876.1944/lib/spark/python/lib/pyspark.zip/pyspark/sql/dataframe.py", line 257, in show
    File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p1876.1944/lib/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 813, in __call__
    File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p1876.1944/lib/spark/python/lib/pyspark.zip/pyspark/sql/utils.py", line 45, in deco
    File "/opt/cloudera/parcels/CDH-5.7.1-1.cdh5.7.1.p1876.1944/lib/spark/python/lib/py4j-0.9-src.zip/py4j/protocol.py", line 308, in get_return_value
  py4j.protocol.Py4JJavaError: An error occurred while calling o718.showString.
  </code></pre>
  
  <p>Can anyone please help me understand the error message. Thanks in advance.</p>