title: Installing local .whl files on Databricks cluster
body: <p>I am trying to connect to a databricks cluster and install a <strong>local</strong> python whl using DatabricksSubmitRunOperator on Airflow (v2.3.2) with following configuration. However, it doesn't work and throws a fileNotFound exception (I checked file path multiple times, file exists).</p>
  <pre><code>task1 = DatabricksSubmitRunOperator(
      task_id = &lt;task_id&gt;,
      job_name = &lt;job_name&gt;,
      existing_cluster_id = &lt;cluster_id&gt;,
      libraries=[
          {&quot;whl&quot;: &quot;file:/&lt;local_absolute_path&gt;&quot;}
      ]
  )
  </code></pre>
  <p>While the <a href="https://docs.databricks.com/dev-tools/api/latest/libraries.html#library" rel="nofollow noreferrer">official documentation</a> states that, for .whl files, only DBFS and S3 storage is supported, in Airflow, I see the following error message when prefix <code>file:/</code> is not attached:</p>
  <pre><code>Library installation failed for library due to user error. 
  Error messages: Python wheels must be stored in dbfs, s3, adls, gs or as a local file. Make sure the URI begins with 'dbfs:', 'file:', 's3:', 'abfss:', 'gs:'
  </code></pre>
  <p>Is it possible install local .whl files on a databricks cluster?</p>
  <p>Alternative approach I tried is to copy .whl to dbfs storage and install it from there. The problem with that is that installation status is stuck at &quot;pending&quot;.</p>
  <p>Any help is appreciated.</p>