title: Is there a way to connect to databricks using ADO.Net?
body: <p>I want to build an API which queries the databricks's tables and output the results as a JSON. One way to achieve this is calling the databricks <a href="https://docs.databricks.com/dev-tools/api/latest/jobs.html#runs-get-output" rel="nofollow noreferrer">Jobs REST API</a> to execute a job and read the job output but that has data size limitations(max of 5MB and my API result set can exceed beyond 20MB). Instead, can I connect to databricks using the JDBC/ODBC endpoint provided by the cluster using Microsoft.Net or if there's any other way to connect directly? My API layer preferably needs to be built in Microsoft.Net. However, I'm willing to try Python.</p>