title: oozie spark 2.0 action giving exception: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging
body: <p>I am getting the below exception while trying to run a spark action using oozie</p>
  
  <pre><code>ERROR yarn.ApplicationMaster: User class threw exception: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging
  java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging
      at java.lang.ClassLoader.defineClass1(Native Method)
      at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
      at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
      at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
      at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
      at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
      at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
      at java.security.AccessController.doPrivileged(Native Method)
      at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      at org.apache.spark.sql.SparkSession$.builder(SparkSession.scala:861)
      at com.spark.morbiditymerge.MorbidityProcessMessage$.main(MorbidityProcessMessage.scala:19)
      at com.spark.morbiditymerge.MorbidityProcessMessage.main(MorbidityProcessMessage.scala)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:542)
  Caused by: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging
      at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      ... 20 more
  </code></pre>
  
  <p>The spark code is running fine locally in eclipse. But, I am getting the above exception while trying to run it using oozie.</p>
  
  <p>I am using spark 2.0 and scala 2.11.8. I have included all the spark 2.0 dependencies in my pom file. </p>
  
  <p>I read in the cloudera documentation that Oozie Spark2 Action is not Supported. Is that the reason why I am getting this exception? If yes, is there any other way to run a spark 2.0 job using oozie?</p>