title: How to use Selenium in Databricks and accessing and moving downloaded files to mounted storage and keep Chrome and ChromeDriver versions in sync?
body: <p>I've seen a couple of posts on using Selenium in Databricks using <code>%sh</code>to install Chrome Drivers and Chrome. This works fine for me, but I had a lot of trouble when I needed to download a file. The file would download, but I could not find it in the filesystem in databricks. Even if I changed the download path when instatiating Chrome to a mounted folder on Azure Blob Storage, the file would not be placed there after downloading. There is also a problem of keeping the Chrome browser and ChromeDriver version in sync automatically without manually changing the version numbers.</p>
  <p>Following links show people with the same problem but no clear answer:</p>
  <p><a href="https://forums.databricks.com/questions/19376/if-my-notebook-downloads-a-file-from-a-website-by.html" rel="nofollow noreferrer">https://forums.databricks.com/questions/19376/if-my-notebook-downloads-a-file-from-a-website-by.html</a></p>
  <p><a href="https://forums.databricks.com/questions/45388/selenium-in-databricks-with-add-experimental-optio.html" rel="nofollow noreferrer">https://forums.databricks.com/questions/45388/selenium-in-databricks-with-add-experimental-optio.html</a></p>
  <p><a href="https://stackoverflow.com/questions/61505582/is-there-a-way-to-identify-where-the-file-gets-downloaded-in-azure-databricks-wh">Is there a way to identify where the file gets downloaded in Azure Databricks when I do web automation using Selenium Python?</a></p>
  <p>And some struggling with getting Selenium to run properly at all:
  <a href="https://forums.databricks.com/questions/14814/selenium-in-databricks.html" rel="nofollow noreferrer">https://forums.databricks.com/questions/14814/selenium-in-databricks.html</a></p>
  <p>not in path error:
  <a href="https://webcache.googleusercontent.com/search?q=cache:NrvVKo4LLdIJ:https://stackoverflow.com/questions/57904372/cannot-get-selenium-webdriver-to-work-in-azure-databricks+&amp;cd=5&amp;hl=en&amp;ct=clnk&amp;gl=us" rel="nofollow noreferrer">https://webcache.googleusercontent.com/search?q=cache:NrvVKo4LLdIJ:https://stackoverflow.com/questions/57904372/cannot-get-selenium-webdriver-to-work-in-azure-databricks+&amp;cd=5&amp;hl=en&amp;ct=clnk&amp;gl=us</a></p>
  <p>Is there a clear guide to use Selenium on Databricks and manage downloaded files? And how can I keep the Chrome browser and ChromeDriver versions in sync automatically?</p>