title: Clear all the Dataframes applicable to a query in Spark Streaming
body: <p>Is there any way to unpersist all the dataframes applicable at query level.</p>
  <p>I want to unpersist all the Dataframes which got persisted during the execution(By calling .persist operation). I would have used below code to do that</p>
  <pre><code>for ( (id,rdd) &lt;- spark.sparkContext.getPersistentRDDs ) {
                        logger.info(&quot;cached RDD &quot; + id)
                        rdd.unpersist()
                      }
                      
  </code></pre>
  <p>But the challenge is in my spark session there are multiple streaming queries are running which are independent of each other. So if I call above method it will unpersist rdds irrespective of the query.</p>