title: Error while using Bigquery connector
body: <p>I am getting this error when running the Spotify Spark Bigquery connector on Qubole data platform. I do see the <code>BigQueryUtils</code> class in my jar but still it throws this error:</p>
  
  <blockquote>
    <p>Exception in thread "main"
    org.spark-project.guava.util.concurrent.ExecutionError:
    java.lang.NoSuchMethodError:
    com.google.cloud.hadoop.io.bigquery.BigQueryUtils.waitForJobCompletion</p>
  </blockquote>
  
  <p>Attaching the pom below...</p>
  
  <pre><code>&lt;?xml version="1.0" encoding="UTF-8"?&gt;
  &lt;project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"&gt;
    &lt;modelVersion&gt;4.0.0&lt;/modelVersion&gt;
    &lt;groupId&gt;com.xyz.abc.google.TestProject&lt;/groupId&gt;
    &lt;artifactId&gt;edesem-google-TestProject&lt;/artifactId&gt;
    &lt;version&gt;0.0.1-SNAPSHOT&lt;/version&gt;
  
    &lt;properties&gt;
      &lt;maven.compiler.source&gt;1.8&lt;/maven.compiler.source&gt;
      &lt;maven.compiler.target&gt;1.8&lt;/maven.compiler.target&gt;
      &lt;project.build.sourceEncoding&gt;UTF-8&lt;/project.build.sourceEncoding&gt;
  
      &lt;gpg.skip&gt;true&lt;/gpg.skip&gt;
  
      &lt;!-- Keep in sync with google-api-client dependency --&gt;
      &lt;apache.httpcomponents.version&gt;4.0.1&lt;/apache.httpcomponents.version&gt;
    &lt;/properties&gt;
  
    &lt;build&gt;
      &lt;sourceDirectory&gt;src/main/scala&lt;/sourceDirectory&gt;
      &lt;plugins&gt;
        &lt;plugin&gt;
          &lt;groupId&gt;net.alchim31.maven&lt;/groupId&gt;
          &lt;artifactId&gt;scala-maven-plugin&lt;/artifactId&gt;
          &lt;version&gt;3.3.1&lt;/version&gt;
          &lt;executions&gt;
            &lt;execution&gt;
              &lt;goals&gt;
                &lt;goal&gt;compile&lt;/goal&gt;
              &lt;/goals&gt;
            &lt;/execution&gt;
          &lt;/executions&gt;
        &lt;/plugin&gt;
  
        &lt;plugin&gt;
          &lt;groupId&gt;org.apache.maven.plugins&lt;/groupId&gt;
          &lt;artifactId&gt;maven-compiler-plugin&lt;/artifactId&gt;
          &lt;version&gt;3.5.1&lt;/version&gt;
          &lt;configuration&gt;
            &lt;source&gt;1.8&lt;/source&gt;
            &lt;target&gt;1.8&lt;/target&gt;
          &lt;/configuration&gt;
        &lt;/plugin&gt;
  
        &lt;plugin&gt;
          &lt;artifactId&gt;maven-assembly-plugin&lt;/artifactId&gt;
          &lt;executions&gt;
            &lt;execution&gt;
              &lt;phase&gt;package&lt;/phase&gt;
              &lt;goals&gt;
                &lt;goal&gt;single&lt;/goal&gt;
              &lt;/goals&gt;
            &lt;/execution&gt;
          &lt;/executions&gt;
          &lt;configuration&gt;
            &lt;descriptorRefs&gt;
              &lt;descriptorRef&gt;jar-with-dependencies&lt;/descriptorRef&gt;
            &lt;/descriptorRefs&gt;
          &lt;/configuration&gt;
        &lt;/plugin&gt;
  
        &lt;!-- Maven Shade Plugin --&gt;
        &lt;plugin&gt;
          &lt;artifactId&gt;maven-shade-plugin&lt;/artifactId&gt;
          &lt;version&gt;2.4&lt;/version&gt;
          &lt;executions&gt;
            &lt;execution&gt;
              &lt;phase&gt;package&lt;/phase&gt;
              &lt;goals&gt;
                &lt;goal&gt;shade&lt;/goal&gt;
              &lt;/goals&gt;
              &lt;configuration&gt;
                &lt;finalName&gt;edesem-google-TestProject&lt;/finalName&gt;
                &lt;shadedArtifactAttached&gt;false&lt;/shadedArtifactAttached&gt;
                &lt;artifactSet&gt;
                  &lt;includes&gt;
                    &lt;include&gt;*:*&lt;/include&gt;
                  &lt;/includes&gt;
                &lt;/artifactSet&gt;
                &lt;filters&gt;
                  &lt;filter&gt;
                    &lt;artifact&gt;*:*&lt;/artifact&gt;
                    &lt;excludes&gt;
                      &lt;exclude&gt;META-INF/*.SF&lt;/exclude&gt;
                      &lt;exclude&gt;META-INF/*.DSA&lt;/exclude&gt;
                      &lt;exclude&gt;META-INF/*.RSA&lt;/exclude&gt;
                    &lt;/excludes&gt;
                  &lt;/filter&gt;
                &lt;/filters&gt;
                &lt;transformers&gt;
                  &lt;transformer implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer" /&gt;
                  &lt;transformer implementation="org.apache.maven.plugins.shade.resource.AppendingTransformer"&gt;
                    &lt;resource&gt;reference.conf&lt;/resource&gt;
                  &lt;/transformer&gt;
                  &lt;transformer implementation="org.apache.maven.plugins.shade.resource.DontIncludeResourceTransformer"&gt;
                    &lt;resource&gt;log4j.properties&lt;/resource&gt;
                  &lt;/transformer&gt;
                  &lt;transformer implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer"&gt;
                    &lt;mainClass&gt;com.xyz.abc.bigquery.TestProjectBQClient&lt;/mainClass&gt;
                  &lt;/transformer&gt;
                &lt;/transformers&gt;
                &lt;relocations&gt;
                  &lt;relocation&gt;
                    &lt;pattern&gt;org.eclipse.jetty&lt;/pattern&gt;
                    &lt;shadedPattern&gt;org.spark-project.jetty&lt;/shadedPattern&gt;
                    &lt;includes&gt;
                      &lt;include&gt;org.eclipse.jetty.**&lt;/include&gt;
                    &lt;/includes&gt;
                  &lt;/relocation&gt;
                  &lt;relocation&gt;
                    &lt;pattern&gt;com.google.common&lt;/pattern&gt;
                    &lt;shadedPattern&gt;org.spark-project.guava&lt;/shadedPattern&gt;
                    &lt;excludes&gt;
                      &lt;exclude&gt;com/google/common/base/Absent*&lt;/exclude&gt;
                      &lt;exclude&gt;com/google/common/base/Function&lt;/exclude&gt;
                      &lt;exclude&gt;com/google/common/base/Optional*&lt;/exclude&gt;
                      &lt;exclude&gt;com/google/common/base/Present*&lt;/exclude&gt;
                      &lt;exclude&gt;com/google/common/base/Supplier&lt;/exclude&gt;
                    &lt;/excludes&gt;
                  &lt;/relocation&gt;
                &lt;/relocations&gt;
              &lt;/configuration&gt;
            &lt;/execution&gt;
          &lt;/executions&gt;
        &lt;/plugin&gt;
      &lt;/plugins&gt;
    &lt;/build&gt;
  
    &lt;dependencies&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.scala-lang&lt;/groupId&gt;
        &lt;artifactId&gt;scala-library&lt;/artifactId&gt;
        &lt;version&gt;2.10.6&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.apache.spark&lt;/groupId&gt;
        &lt;artifactId&gt;spark-core_2.10&lt;/artifactId&gt;
        &lt;version&gt;2.2.0&lt;/version&gt;
        &lt;scope&gt;provided&lt;/scope&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.apache.spark&lt;/groupId&gt;
        &lt;artifactId&gt;spark-sql_2.10&lt;/artifactId&gt;
        &lt;version&gt;2.2.0&lt;/version&gt;
        &lt;scope&gt;provided&lt;/scope&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.databricks&lt;/groupId&gt;
        &lt;artifactId&gt;spark-avro_2.10&lt;/artifactId&gt;
        &lt;version&gt;4.0.0&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.cloud.bigdataoss&lt;/groupId&gt;
        &lt;artifactId&gt;bigquery-connector&lt;/artifactId&gt;
        &lt;version&gt;0.10.2-hadoop2&lt;/version&gt;
        &lt;exclusions&gt;
          &lt;exclusion&gt;
            &lt;groupId&gt;com.google.guava&lt;/groupId&gt;
            &lt;artifactId&gt;guava-jdk5&lt;/artifactId&gt;
          &lt;/exclusion&gt;
        &lt;/exclusions&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.slf4j&lt;/groupId&gt;
        &lt;artifactId&gt;slf4j-simple&lt;/artifactId&gt;
        &lt;version&gt;1.7.21&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;joda-time&lt;/groupId&gt;
        &lt;artifactId&gt;joda-time&lt;/artifactId&gt;
        &lt;version&gt;2.9.3&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.scalatest&lt;/groupId&gt;
        &lt;artifactId&gt;scalatest_2.10&lt;/artifactId&gt;
        &lt;version&gt;2.2.1&lt;/version&gt;
        &lt;scope&gt;test&lt;/scope&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.cloud.bigdataoss&lt;/groupId&gt;
        &lt;artifactId&gt;gcs-connector&lt;/artifactId&gt;
        &lt;version&gt;1.8.0-hadoop2&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;!-- https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/util-hadoop --&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.cloud.bigdataoss&lt;/groupId&gt;
        &lt;artifactId&gt;util-hadoop&lt;/artifactId&gt;
        &lt;version&gt;1.8.0-hadoop2&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;!-- https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcsio --&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.cloud.bigdataoss&lt;/groupId&gt;
        &lt;artifactId&gt;gcsio&lt;/artifactId&gt;
        &lt;version&gt;1.8.0&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.cloud.bigdataoss&lt;/groupId&gt;
        &lt;artifactId&gt;util&lt;/artifactId&gt;
        &lt;version&gt;1.8.0&lt;/version&gt;
        &lt;exclusions&gt;
          &lt;exclusion&gt;
            &lt;groupId&gt;com.google.api-client&lt;/groupId&gt;
            &lt;artifactId&gt;google-api-client-java6&lt;/artifactId&gt;
          &lt;/exclusion&gt;
          &lt;exclusion&gt;
            &lt;groupId&gt;com.google.guava&lt;/groupId&gt;
            &lt;artifactId&gt;guava-jdk5&lt;/artifactId&gt;
          &lt;/exclusion&gt;
        &lt;/exclusions&gt;
      &lt;/dependency&gt;
      &lt;!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-mapreduce-client-core --&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.apache.hadoop&lt;/groupId&gt;
        &lt;artifactId&gt;hadoop-mapreduce-client-core&lt;/artifactId&gt;
        &lt;version&gt;2.8.3&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common --&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;org.apache.hadoop&lt;/groupId&gt;
        &lt;artifactId&gt;hadoop-common&lt;/artifactId&gt;
        &lt;version&gt;2.8.3&lt;/version&gt;
        &lt;scope&gt;provided&lt;/scope&gt;
      &lt;/dependency&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.guava&lt;/groupId&gt;
        &lt;artifactId&gt;guava&lt;/artifactId&gt;
        &lt;version&gt;23.6-jre&lt;/version&gt;
      &lt;/dependency&gt;
      &lt;!-- https://mvnrepository.com/artifact/com.google.cloud/google-cloud-bigquery --&gt;
      &lt;dependency&gt;
        &lt;groupId&gt;com.google.cloud&lt;/groupId&gt;
        &lt;artifactId&gt;google-cloud-bigquery&lt;/artifactId&gt;
        &lt;version&gt;1.23.0&lt;/version&gt;
      &lt;/dependency&gt;
    &lt;/dependencies&gt;
  &lt;/project&gt;
  </code></pre>