title: Azure Blob Storage Spark
body: <p>I'm trying to connect Spark to azure blob storage (<strong>wasbs</strong>).
  I add the following jars in the hadoop classpath</p>
  
  <pre><code>com.microsoft.azure_azure-storage-7.0.0.jar
  org.apache.hadoop_hadoop-annotations-3.1.2.jar
  org.apache.hadoop_hadoop-auth-3.1.2.jar
  org.apache.hadoop_hadoop-azure-3.1.2.jar
  org.apache.hadoop_hadoop-common-3.1.2.jar
  org.eclipse.jetty_jetty-http-9.3.24.v20180605.jar
  org.eclipse.jetty_jetty-io-9.3.24.v20180605.jar
  org.eclipse.jetty_jetty-security-9.3.24.v20180605.jar
  org.eclipse.jetty_jetty-server-9.3.24.v20180605.jar
  org.eclipse.jetty_jetty-servlet-9.3.24.v20180605.jar
  org.eclipse.jetty_jetty-webapp-9.3.24.v20180605.jar
  org.eclipse.jetty_jetty-xml-9.3.24.v20180605.jar
  </code></pre>
  
  <p>and i try to use spark-submit using:</p>
  
  <pre><code>spark-submit --class mainClass --jars jars/org.apache.hadoop_hadoop-azure-3.1.2.jar,jars/com.microsoft.azure_azure-storage-7.0.0.jar,jars/org.apache.hadoop_hadoop-common-3.1.2.jar myjar.jar
  </code></pre>
  
  <p>and i get the following exception:</p>
  
  <pre><code>Exception in thread "main" java.lang.NoClassDefFoundError: org/eclipse/jetty/util/ajax/JSON$Convertor
  </code></pre>
  
  <p>If i remove <strong>hadoop-commons</strong> from the spark-submit --jars i get:</p>
  
  <pre><code>Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/fs/StreamCapabilities
  </code></pre>
  
  <p>and if i add --jars jars/* to include all the jar files along with the jetty-utils i get</p>
  
  <pre><code>java.lang.ClassNotFoundException: my.package.MainClass
  </code></pre>
  
  <p>i saw similar posts that indicate multiple versions of jetty, but i can't find other versions anywhere.</p>