title: How to set up a spark build.sbt file?
body: <p>I have been trying all day and cannot figure out how to make it work.</p>
  
  <p>So I have a <code>common</code> library that will be my core lib for <code>spark</code>.</p>
  
  <p>My <code>build.sbt</code> file is not working:</p>
  
  <pre><code>name := "CommonLib"
  
  version := "0.1"
  
  scalaVersion := "2.12.5"
  
  // addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.6")
  
  // resolvers += "bintray-spark-packages" at "https://dl.bintray.com/spark-packages/maven/"
  // resolvers += Resolver.sonatypeRepo("public")
  
  libraryDependencies ++= Seq(
        "org.apache.spark" % "spark-core_2.10" % "1.6.0" exclude("org.apache.hadoop", "hadoop-yarn-server-web-proxy"),
        "org.apache.spark" % "spark-sql_2.10" % "1.6.0" exclude("org.apache.hadoop", "hadoop-yarn-server-web-proxy"),
        "org.apache.hadoop" % "hadoop-common" % "2.7.0" exclude("org.apache.hadoop", "hadoop-yarn-server-web-proxy"),
        //  "org.apache.spark" % "spark-sql_2.10" % "1.6.0" exclude("org.apache.hadoop", "hadoop-yarn-server-web-proxy"),
        "org.apache.spark" % "spark-hive_2.10" % "1.6.0" exclude("org.apache.hadoop", "hadoop-yarn-server-web-proxy"),
        "org.apache.spark" % "spark-yarn_2.10" % "1.6.0" exclude("org.apache.hadoop", "hadoop-yarn-server-web-proxy"),
        "com.github.scopt" %% "scopt" % "3.7.0"
  )
  
  //addSbtPlugin("org.spark-packages" % "sbt-spark-package" % "0.2.6")
  
  //libraryDependencies += "org.apache.spark" %% "spark-sql" % "2.3.0"
  
  //libraryDependencies ++= {
  //  val sparkVer = "2.1.0"
  //  Seq(
  //    "org.apache.spark" %% "spark-core" % sparkVer % "provided" withSources()
  //  )
  //}
  </code></pre>
  
  <p>All the commented out are all the test I've done and I don't know what to do anymore. </p>
  
  <p>My goal is to have spark 2.3 to work and to have <code>scope</code> available too. </p>
  
  <p>For my sbt version, I have <code>1.1.1</code> installed. </p>
  
  <p>Thank you. </p>