title: Dataproc PySpark Streaming job failing at connecting to Resource Manager
body: <p>My PySpark streaming job on Google Cloud Dataproc cluster is failing at initial stage, saying connecting to Resource Manager and fails.</p>
  
  <p>Same code runs successfully on my local host.</p>
  
  <p>Error message:</p>
  
  <blockquote>
    <p>INFO org.apache.hadoop.yarn.client.RMProxy: Connecting to
    ResourceManager at clustername/ Job output is complete</p>
  </blockquote>
  
  <p>In this job, checkpoint file and jars sits on master to enable recovery from checkpoint directory for one time as suggested by Dennis <a href="https://stackoverflow.com/questions/41112171/spark-streaming-on-dataproc-throws-filenotfoundexception">here</a></p>