title: Spark 2.0: How to list or remove dirs and files in s3
body: <p>Is there any way to list files and dirs, remove files and dirs, check if a dir exists, etc directly from spark 2.0 shell?</p>
  
  <p>I am able to use os python library but it just 'sees' local dirs, not s3.</p>
  
  <p>I have also found this but I cannot make it work
  <a href="http://bigdatatech.taleia.software/2015/12/21/check-if-exists-a-amazon-s3-path-from-apache-spark/" rel="nofollow">http://bigdatatech.taleia.software/2015/12/21/check-if-exists-a-amazon-s3-path-from-apache-spark/</a></p>
  
  <p>Thanks</p>