{"action":"created","issue":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/692","repository_url":"https://api.github.com/repos/andypetrella/spark-notebook","labels_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/692/labels{/name}","comments_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/692/comments","events_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/692/events","html_url":"https://github.com/andypetrella/spark-notebook/issues/692","id":172084947,"number":692,"title":"error: not found: value globalScope when running in docker","user":{"login":"davidshen84","id":65741,"avatar_url":"https://avatars.githubusercontent.com/u/65741?v=3","gravatar_id":"","url":"https://api.github.com/users/davidshen84","html_url":"https://github.com/davidshen84","followers_url":"https://api.github.com/users/davidshen84/followers","following_url":"https://api.github.com/users/davidshen84/following{/other_user}","gists_url":"https://api.github.com/users/davidshen84/gists{/gist_id}","starred_url":"https://api.github.com/users/davidshen84/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/davidshen84/subscriptions","organizations_url":"https://api.github.com/users/davidshen84/orgs","repos_url":"https://api.github.com/users/davidshen84/repos","events_url":"https://api.github.com/users/davidshen84/events{/privacy}","received_events_url":"https://api.github.com/users/davidshen84/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-08-19T08:56:13Z","updated_at":"2016-08-22T02:44:56Z","closed_at":null,"body":"I got the docker image from spark-notebook.io, the build details are:\r\n\r\n> Build: |  buildTime-Sat Jul 02 14:54:35 UTC 2016 | formattedShaVersion-0.6.3-61efca56c2a45613ec609f350dc4911b166b3f28-SNAPSHOT | sbtVersion-0.13.8 | scalaVersion-2.11.7 | sparkNotebookVersion-0.6.3 | hadoopVersion-2.7.2 | jets3tVersion-0.7.1 | jlineDef-(jline,2.12) | sparkVersion-1.6.2 | withHive-false | withParquet-false |.\r\n\r\nIn a new notebook, I ran\r\n\r\n` :dp \"com.typesafe.akka\" %% \"akka-http-core\" % \"2.4.9-RC2\"`\r\n\r\nthen got\r\n\r\n```\r\n<console>:19: error: not found: value globalScope\r\n       globalScope.jars.toList\r\n       ^\r\n<console>:24: error: not found: value globalScope\r\nval $ires0 = globalScope.jars\r\n             ^\r\n<console>:11: error: not found: value globalScope\r\n       globalScope.sparkContext.setJobGroup(\"cell-2E1CDEF6901E4BE7AAD712BEA1AEF532\", \"run-1471596220042: updating depsglobalScope.jars = (List('tmprepocomtypesafeconfig1.3.0config-1.3.0.jar''tmprepoorgreactivestreamsreactive-streams1.0.0reactive-streams-1.0.0.jar''tmprepoorgscala-langscala-library2.11.8scala-library-2.11.8.jar''tmprepocomtypesafeakkaakka-htt\")\r\n       ^\r\n<console>:14: error: not found: value globalScope\r\n       globalScope.jars = (List(\"/tmp/repo/com/typesafe/config/1.3.0/config-1.3.0.jar\",\"/tmp/repo/org/reactivestreams/reactive-streams/1.0.0/reactive-streams-1.0.0.jar\",\"/tmp/repo/org/scala-lang/scala-library/2.11.8/scala-library-2.11.8.jar\",\"/tmp/repo/com/typesafe/akka/akka-http-core_2.11/2.4.9-RC2/akka-http-core_2.11-2.4.9-RC2.jar\",\"/tmp/repo/org/scala-lang/modules/scala-java8-compat_2.11/0.7.0/scala-java8-compat_2.11-0.7.0.jar\",\"/tmp/repo/com/typesafe/akka/akka-actor_2.11/2.4.9-RC2/akka-actor_2.11-2.4.9-RC2.jar\",\"/tmp/repo/com/typesafe/ssl-config-core_2.11/0.2.1/ssl-config-core_2.11-0.2.1.jar\",\"/tmp/repo/com/typesafe/akka/akka-stream_2.11/2.4.9-RC2/akka-stream_2.11-2.4.9-RC2.jar\",\"/tmp/repo/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar\",\"/tmp/repo/com/typesafe/ssl-config-akka_2.11/0.2.1/ssl-config-akka_2.11-0.2.1.jar\",\"/tmp/repo/com/typesafe/akka/akka-parsing_2.11/2.4.9-RC2/akka-parsing_2.11-2.4.9-RC2.jar\") ::: globalScope.jars.toList).distinct.toArray\r\n       ^\r\n<console>:16: error: not found: value reset\r\n       reset()\r\n       ^\r\n```\r\n\r\nBut if I ran the same `:dp` from a non-docker notebook, the dependencies are resolved."},"comment":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/comments/241303769","html_url":"https://github.com/andypetrella/spark-notebook/issues/692#issuecomment-241303769","issue_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/692","id":241303769,"user":{"login":"andypetrella","id":663344,"avatar_url":"https://avatars.githubusercontent.com/u/663344?v=3","gravatar_id":"","url":"https://api.github.com/users/andypetrella","html_url":"https://github.com/andypetrella","followers_url":"https://api.github.com/users/andypetrella/followers","following_url":"https://api.github.com/users/andypetrella/following{/other_user}","gists_url":"https://api.github.com/users/andypetrella/gists{/gist_id}","starred_url":"https://api.github.com/users/andypetrella/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andypetrella/subscriptions","organizations_url":"https://api.github.com/users/andypetrella/orgs","repos_url":"https://api.github.com/users/andypetrella/repos","events_url":"https://api.github.com/users/andypetrella/events{/privacy}","received_events_url":"https://api.github.com/users/andypetrella/received_events","type":"User","site_admin":false},"created_at":"2016-08-22T02:44:56Z","updated_at":"2016-08-22T02:44:56Z","body":"ooooh indeed that's because the current docker are still using Java7...\nand there is something in Java8 now damn it\nand worth trying using and sbt build of your own\nI'll update the generator to use java8 later\nsry\n\nOn Sun, 21 Aug 2016 19:21 Xi Shen, <notifications@github.com> wrote:\n\n> Hi Andy,\n>\n> Here are the details of the error I mentioned at the beginning:\n>\n> - Docker image e8d358e72cea\n> - Create a new notebook\n> - Insert \":dp com.typesafe.akka %% akka-http-core % 2.4.9-RC2\" in the first\n> cell and execute\n>\n> In the browser console, there are tons of logs, and I think these two might\n> be what you are looking for:\n>\n> ```\n> Server log> [Mon Aug 22 2016 10:13:52 GMT+0800 (China Standard Time)]\n> [Aether downloads]\n> Resolved/Downloaded:\n> * org.scala-lang.modules:scala-parser-combinators_2.11:jar:1.0.4\n> * com.typesafe:config:jar:1.3.0\n> * com.typesafe.akka:akka-actor_2.11:jar:2.4.9-RC2\n> * com.typesafe.akka:akka-stream_2.11:jar:2.4.9-RC2\n> * com.typesafe.akka:akka-http-core_2.11:jar:2.4.9-RC2\n> * org.reactivestreams:reactive-streams:jar:1.0.0\n> * com.typesafe:ssl-config-core_2.11:jar:0.2.1\n> * com.typesafe.akka:akka-parsing_2.11:jar:2.4.9-RC2\n> * org.scala-lang.modules:scala-java8-compat_2.11:jar:0.7.0\n> * com.typesafe:ssl-config-akka_2.11:jar:0.2.1\n> * org.scala-lang:scala-library:jar:2.11.8\n> ===================================================\n> ```\n>\n> ```\n> kernel.js:975 Server log> [Mon Aug 22 2016 10:14:00 GMT+0800 (China\n> Standard Time)] [notebook.client.ReplCalculator] Error in init script:\n> java.lang.UnsupportedClassVersionError:\n> akka/dispatch/BoundedControlAwareMessageQueueSemantics : Unsupported\n> major.minor version 52.0\n> at java.lang.ClassLoader.defineClass1(Native Method)\n> at java.lang.ClassLoader.defineClass(ClassLoader.java:803)\n> at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)\n> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)\n> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)\n> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)\n> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)\n> at java.security.AccessController.doPrivileged(Native Method)\n> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)\n> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)\n> at java.lang.ClassLoader.loadClass(ClassLoader.java:412)\n> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)\n> at java.lang.Class.forName0(Native Method)\n> at java.lang.Class.forName(Class.java:278)\n> at\n>\n> akka.actor.ReflectiveDynamicAccess$$anonfun$getClassFor$1.apply(DynamicAccess.scala:67)\n> at\n>\n> akka.actor.ReflectiveDynamicAccess$$anonfun$getClassFor$1.apply(DynamicAccess.scala:66)\n> at scala.util.Try$.apply(Try.scala:192)\n> at akka.actor.ReflectiveDynamicAccess.getClassFor(DynamicAccess.scala:66)\n> at akka.dispatch.Mailboxes$$anonfun$2.apply(Mailboxes.scala:65)\n> at akka.dispatch.Mailboxes$$anonfun$2.apply(Mailboxes.scala:63)\n> at\n>\n> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:155)\n> at\n>\n> scala.collection.TraversableOnce$$anonfun$foldLeft$1.apply(TraversableOnce.scala:155)\n> at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)\n> at\n> scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)\n> at\n> scala.collection.TraversableOnce$class.foldLeft(TraversableOnce.scala:155)\n> at scala.collection.AbstractTraversable.foldLeft(Traversable.scala:104)\n> at akka.dispatch.Mailboxes.<init>(Mailboxes.scala:63)\n> at akka.actor.ActorSystemImpl.<init>(ActorSystem.scala:594)\n> at akka.actor.ActorSystem$.apply(ActorSystem.scala:142)\n> at akka.actor.ActorSystem$.apply(ActorSystem.scala:119)\n> at\n>\n> org.apache.spark.util.AkkaUtils$.org$apache$spark$util$AkkaUtils$$doCreateActorSystem(AkkaUtils.scala:121)\n> at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:53)\n> at org.apache.spark.util.AkkaUtils$$anonfun$1.apply(AkkaUtils.scala:52)\n> at\n>\n> org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:2024)\n> at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:166)\n> at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:2015)\n> at org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:55)\n> at org.apache.spark.SparkEnv$.create(SparkEnv.scala:266)\n> at org.apache.spark.SparkEnv$.createDriverEnv(SparkEnv.scala:193)\n> at org.apache.spark.SparkContext.createSparkEnv(SparkContext.scala:288)\n> at org.apache.spark.SparkContext.<init>(SparkContext.scala:457)\n> at $anon$1.reset(<console>:147)\n> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n> at\n>\n> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n> at\n>\n> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n> at java.lang.reflect.Method.invoke(Method.java:606)\n> ... 46 elided\n> ```\n>\n>\n>\n> On Sun, Aug 21, 2016 at 6:30 AM Andy Petrella <notifications@github.com>\n> wrote:\n>\n> > using master I could put that in the metadata, as an example of some\n> > import they're the experimental but it works just fine (don't forget to\n> > restart the kernel after having updated the metadata)\n> >\n> > \"customDeps\": [\n> > \"com.typesafe.akka %% akka-http-experimental % 1.0\",\n> > \"com.typesafe.akka %% akka-http-xml-experimental % 1.0\",\n> > \"com.typesafe.akka %% akka-http-spray-json-experimental % 1.0\",\n> > \"com.datastax.spark %% spark-cassandra-connector % 1.4.1\",\n> > \"- org.apache.spark %% spark-core % _\",\n> > \"- org.apache.spark %% spark-streaming % _\",\n> > \"- org.scala-lang % _ % _\",\n> > \"- org.spark-project.spark % _ % _\",\n> > \"- io.netty % _ % _\",\n> > \"- javax.jms % jms % _\",\n> > \"- com.sun.jdmk % jmxtools % _\",\n> > \"- com.sun.jmx % jmxri % _\"\n> > ],\n> >\n> > —\n> > You are receiving this because you authored the thread.\n> > Reply to this email directly, view it on GitHub\n> > <\n> https://github.com/andypetrella/spark-notebook/issues/692#issuecomment-241227845\n> >,\n> > or mute the thread\n> > <\n> https://github.com/notifications/unsubscribe-auth/AAEAzQls35fJrLimZ5Lfba466TBfLxc_ks5qh3_1gaJpZM4JoRpy\n> >\n> > .\n> >\n> --\n>\n>\n> Thanks,\n> David S.\n>\n> —\n> You are receiving this because you commented.\n>\n>\n> Reply to this email directly, view it on GitHub\n> <https://github.com/andypetrella/spark-notebook/issues/692#issuecomment-241301439>,\n> or mute the thread\n> <https://github.com/notifications/unsubscribe-auth/AAofML_WlM78jCS0S41squS0mLoC_0Hgks5qiQehgaJpZM4JoRpy>\n> .\n>\n"}}
{"actor":{"display_login":"andypetrella"}}