{"action":"created","issue":{"url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8","repository_url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture","labels_url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8/labels{/name}","comments_url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8/comments","events_url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8/events","html_url":"https://github.com/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8","id":193728228,"number":8,"title":"Kafka receiver demo","user":{"login":"VictorPelaez","id":9797745,"avatar_url":"https://avatars.githubusercontent.com/u/9797745?v=3","gravatar_id":"","url":"https://api.github.com/users/VictorPelaez","html_url":"https://github.com/VictorPelaez","followers_url":"https://api.github.com/users/VictorPelaez/followers","following_url":"https://api.github.com/users/VictorPelaez/following{/other_user}","gists_url":"https://api.github.com/users/VictorPelaez/gists{/gist_id}","starred_url":"https://api.github.com/users/VictorPelaez/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/VictorPelaez/subscriptions","organizations_url":"https://api.github.com/users/VictorPelaez/orgs","repos_url":"https://api.github.com/users/VictorPelaez/repos","events_url":"https://api.github.com/users/VictorPelaez/events{/privacy}","received_events_url":"https://api.github.com/users/VictorPelaez/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-12-06T09:55:59Z","updated_at":"2016-12-08T10:18:54Z","closed_at":null,"body":"Hi, \r\n\r\nWhen I am running spark streaming kafka receiver demo in Zeppelin, I get an error due to \"Logging\". I have read that spark 1.6.2 or 1.6.3 don´t support it. (http://stackoverflow.com/questions/38893655/spark-twitter-streaming-exception-org-apache-spark-logging-classnotfound)\r\n\r\njava.lang.NoClassDefFoundError: org/apache/spark/Logging\r\n  at java.lang.ClassLoader.defineClass1(Native Method)\r\n  at java.lang.ClassLoader.defineClass(ClassLoader.java:760)\r\n  at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)\r\n  at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)\r\n  at java.net.URLClassLoader.access$100(URLClassLoader.java:73)\r\n  at java.net.URLClassLoader$1.run(URLClassLoader.java:368)\r\n  at java.net.URLClassLoader$1.run(URLClassLoader.java:362)\r\n  at java.security.AccessController.doPrivileged(Native Method)\r\n  at java.net.URLClassLoader.findClass(URLClassLoader.java:361)\r\n  at java.lang.ClassLoader.loadClass(ClassLoader.java:424)\r\n  at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)\r\n  at java.lang.ClassLoader.loadClass(ClassLoader.java:357)\r\n  at org.apache.spark.streaming.kafka.KafkaUtils$.createStream(KafkaUtils.scala:81)\r\n  ... 46 elided\r\nCaused by: java.lang.ClassNotFoundException: org.apache.spark.Logging\r\n  at java.net.URLClassLoader.findClass(URLClassLoader.java:381)\r\n  at java.lang.ClassLoader.loadClass(ClassLoader.java:424)\r\n  at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)\r\n  at java.lang.ClassLoader.loadClass(ClassLoader.java:357)\r\n  ... 59 more\r\n\r\nI have imported and inserted in the interpreter the dependences for kafka. Any ideas?\r\n\r\nThanks  \r\n"},"comment":{"url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/comments/265704894","html_url":"https://github.com/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8#issuecomment-265704894","issue_url":"https://api.github.com/repos/aalkilani/spark-kafka-cassandra-applying-lambda-architecture/issues/8","id":265704894,"user":{"login":"VictorPelaez","id":9797745,"avatar_url":"https://avatars.githubusercontent.com/u/9797745?v=3","gravatar_id":"","url":"https://api.github.com/users/VictorPelaez","html_url":"https://github.com/VictorPelaez","followers_url":"https://api.github.com/users/VictorPelaez/followers","following_url":"https://api.github.com/users/VictorPelaez/following{/other_user}","gists_url":"https://api.github.com/users/VictorPelaez/gists{/gist_id}","starred_url":"https://api.github.com/users/VictorPelaez/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/VictorPelaez/subscriptions","organizations_url":"https://api.github.com/users/VictorPelaez/orgs","repos_url":"https://api.github.com/users/VictorPelaez/repos","events_url":"https://api.github.com/users/VictorPelaez/events{/privacy}","received_events_url":"https://api.github.com/users/VictorPelaez/received_events","type":"User","site_admin":false},"created_at":"2016-12-08T10:18:54Z","updated_at":"2016-12-08T10:18:54Z","body":"Hi, I found this problem with Zeppelin. I posted in the Discussion board an other issue about the YARN demo, but I don´t think they are relationed. Already with box v.0.0.6 (Spark 1.6.3 and Kafka 0.9.0.0), in Spark intepreter I added (instead of yours):\r\n\r\n- org.apache.kafka:kafka_2.11:0.9.0.0\r\n- org.apache.spark:spark-streaming-kafka-assembly_2.11:1.6.3\r\n\r\nThen, LogProducer runs perfectly and starts to send messages. Just execute your Zeppelin notebook for this demo (all the imports and ssc creation works for me) and it gives me an error in :\r\n\r\n_val kstream = KafkaUtils.createStream[String, String, StringDecoder, StringDecoder](ssc, kafkaParams, Map(\"weblogs-text\" -> 1), StorageLevel.MEMORY_AND_DISK).map(_._2)__\r\n\r\nError trace is the same published in last comment. Also, I tried to change all the versions in pom dependences, but still fails.\r\n\r\n![kafka_zeppelin](https://cloud.githubusercontent.com/assets/9797745/21006103/acb64e4e-bd37-11e6-886b-5d037480724a.png)\r\n"}}
{"actor":{"display_login":"VictorPelaez"}}