title: How to delete the progress directory generated by spark -streaming application recieving messages from eventhub
body: <p>the process directory generated by Eventhubutils library is creating a lot of small files in hdfs.<a href="https://github.com/Azure/spark-eventhubs/blob/master/docs/direct_stream.md" rel="nofollow noreferrer">https://github.com/Azure/spark-eventhubs/blob/master/docs/direct_stream.md</a>. due to these small files, there is a lot of load on the namenode .Is there any way to delete the progress directory without disturbing the spark application.</p>
  
  <p><a href="https://i.stack.imgur.com/Dxzk0.jpg" rel="nofollow noreferrer">enter image description here</a></p>