title: Spark - How to change the name of the coalesced parquet file
body: <p>So, when writing parquet files to s3, I'm able to change the directory name using the following code:</p>
  
  <pre><code>spark_NCDS_df.coalesce(1).write.parquet(s3locationC1+"parquet")
  </code></pre>
  
  <p>Now, when I output this, the contents within that directory are as follows:</p>
  
  <p><a href="https://i.stack.imgur.com/72C7r.jpg" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/72C7r.jpg" alt="enter image description here"></a></p>
  
  <p>I'd like to make two changes:</p>
  
  <ul>
  <li><p>Can I update the file name for the <code>part-0000....snappy.parquet</code> file?</p></li>
  <li><p>Can I output this file without the <code>_SUCCESS</code>, <code>_committed</code> and <code>_started</code> files?</p></li>
  </ul>
  
  <p>The documentation i've found online hasn't been very helpful. </p>