title: spark-submit scheduling in cron
body: <p>I would like to schedule a pyspark script in crontab to run each 5 minutes. I have successfully launched the script manually using this command:  </p>
  
  <pre><code>spark-submit script.py
  </code></pre>
  
  <p>The problem is that the same command does not seem to work when launched from crontab. The logs don't show anything any details (they are truncated) </p>
  
  <pre><code>*/5 * * * * /path/script.sh
  </code></pre>
  
  <p>The file script.sh contains: spark-submit script.py</p>
  
  <p>Please let me know if you have any ideas on how to solve this issue.</p>