title: Spark transactional write operation using temporary directories
body: <p>According to <a href="https://databricks.com/blog/2017/05/31/transactional-writes-cloud-storage.html" rel="nofollow noreferrer">this</a> blog at databricks, spark relies on commit protocol classes from Hadoop so if job is not finished because of some failure output directory does not change(partial output files do not occurs).</p>
  
  <p>So my questions are ;</p>
  
  <p>Does spark prevent partial writes to different storages in case of failures (HDFS,S3 etc)?</p>
  
  <p>Is it possible for a different spark jobs to use same temporary location before final write operation ?</p>
  
  <p>Is it possible for a same spark job which is submitted more than once to use same temporary location ?</p>