{"action":"created","issue":{"url":"https://api.github.com/repos/JanusGraph/janusgraph/issues/1159","repository_url":"https://api.github.com/repos/JanusGraph/janusgraph","labels_url":"https://api.github.com/repos/JanusGraph/janusgraph/issues/1159/labels{/name}","comments_url":"https://api.github.com/repos/JanusGraph/janusgraph/issues/1159/comments","events_url":"https://api.github.com/repos/JanusGraph/janusgraph/issues/1159/events","html_url":"https://github.com/JanusGraph/janusgraph/issues/1159","id":339523680,"node_id":"MDU6SXNzdWUzMzk1MjM2ODA=","number":1159,"title":"OLAP with Cassandra 3 input fails with Guava error","user":{"login":"pluradj","id":4974160,"node_id":"MDQ6VXNlcjQ5NzQxNjA=","avatar_url":"https://avatars1.githubusercontent.com/u/4974160?v=4","gravatar_id":"","url":"https://api.github.com/users/pluradj","html_url":"https://github.com/pluradj","followers_url":"https://api.github.com/users/pluradj/followers","following_url":"https://api.github.com/users/pluradj/following{/other_user}","gists_url":"https://api.github.com/users/pluradj/gists{/gist_id}","starred_url":"https://api.github.com/users/pluradj/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pluradj/subscriptions","organizations_url":"https://api.github.com/users/pluradj/orgs","repos_url":"https://api.github.com/users/pluradj/repos","events_url":"https://api.github.com/users/pluradj/events{/privacy}","received_events_url":"https://api.github.com/users/pluradj/received_events","type":"User","site_admin":false},"labels":[{"id":524415687,"node_id":"MDU6TGFiZWw1MjQ0MTU2ODc=","url":"https://api.github.com/repos/JanusGraph/janusgraph/labels/cassandra","name":"cassandra","color":"fbca04","default":false},{"id":511807161,"node_id":"MDU6TGFiZWw1MTE4MDcxNjE=","url":"https://api.github.com/repos/JanusGraph/janusgraph/labels/docs","name":"docs","color":"bfd4f2","default":false},{"id":988557645,"node_id":"MDU6TGFiZWw5ODg1NTc2NDU=","url":"https://api.github.com/repos/JanusGraph/janusgraph/labels/spark","name":"spark","color":"f79656","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/JanusGraph/janusgraph/milestones/4","html_url":"https://github.com/JanusGraph/janusgraph/milestone/4","labels_url":"https://api.github.com/repos/JanusGraph/janusgraph/milestones/4/labels","id":2802018,"node_id":"MDk6TWlsZXN0b25lMjgwMjAxOA==","number":4,"title":"Release v0.3.0","description":"","creator":{"login":"sjudeng","id":11000076,"node_id":"MDQ6VXNlcjExMDAwMDc2","avatar_url":"https://avatars3.githubusercontent.com/u/11000076?v=4","gravatar_id":"","url":"https://api.github.com/users/sjudeng","html_url":"https://github.com/sjudeng","followers_url":"https://api.github.com/users/sjudeng/followers","following_url":"https://api.github.com/users/sjudeng/following{/other_user}","gists_url":"https://api.github.com/users/sjudeng/gists{/gist_id}","starred_url":"https://api.github.com/users/sjudeng/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sjudeng/subscriptions","organizations_url":"https://api.github.com/users/sjudeng/orgs","repos_url":"https://api.github.com/users/sjudeng/repos","events_url":"https://api.github.com/users/sjudeng/events{/privacy}","received_events_url":"https://api.github.com/users/sjudeng/received_events","type":"User","site_admin":false},"open_issues":0,"closed_issues":161,"state":"closed","created_at":"2017-09-29T04:07:52Z","updated_at":"2018-08-07T15:22:36Z","due_on":"2018-07-31T07:00:00Z","closed_at":"2018-08-07T15:22:36Z"},"comments":4,"created_at":"2018-07-09T16:36:08Z","updated_at":"2018-10-10T08:45:41Z","closed_at":"2018-07-30T23:45:18Z","author_association":"MEMBER","body":"This was mentioned on [janusgraph-users](https://groups.google.com/d/msg/janusgraph-users/j1t-CelBmkk/7U-EdKK7CAAJ).\r\n\r\nThe scenario is running a SparkGraphComputer job on the master branch (0.3.0-SNAPSHOT) against Spark 2.2.0 cluster using the `conf/hadoop-graph/read-cassandra-3.properties`.\r\n\r\n```\r\ngraph = GraphFactory.open('conf/hadoop-graph/read-cassandra-3.properties')\r\ng = graph.traversal().withComputer(SparkGraphComputer)\r\ng.V().count()\r\n```\r\n\r\nThe error most readily seen from the Gremlin Console is:\r\n\r\n```\r\njava.lang.NoClassDefFoundError: Could not initialize class com.datastax.driver.core.Cluster\r\n```\r\n\r\nThe `NoClassDefFoundError` seems to indicate that a jar file is missing, but it is misleading because looking more closely at the nested exceptions in the Spark worker:\r\n\r\n```\r\njava.lang.ExceptionInInitializerError\r\n        at com.datastax.driver.core.Cluster.<clinit>(Cluster.java:68)\r\n        at org.janusgraph.hadoop.formats.cassandra.CqlBridgeRecordReader.initialize(CqlBridgeRecordReader.java:127)\r\n        at org.janusgraph.hadoop.formats.util.GiraphRecordReader.initialize(GiraphRecordReader.java:60)\r\n        at org.apache.spark.rdd.NewHadoopRDD$$anon$1.liftedTree1$1(NewHadoopRDD.scala:182)\r\n        at org.apache.spark.rdd.NewHadoopRDD$$anon$1.<init>(NewHadoopRDD.scala:179)\r\n        at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:134)\r\n        at org.apache.spark.rdd.NewHadoopRDD.compute(NewHadoopRDD.scala:69)\r\n        at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)\r\n        ... snip ...\r\nCaused by: com.datastax.driver.core.exceptions.DriverInternalError: Detected incompatible version of Guava in the classpath. You need 16.0.1 or higher.\r\n        at com.datastax.driver.core.GuavaCompatibility.selectImplementation(GuavaCompatibility.java:138)\r\n        at com.datastax.driver.core.GuavaCompatibility.<clinit>(GuavaCompatibility.java:52)\r\n        ... 30 more\r\n```\r\n\r\nTrying to run with the other Cassandra input format:\r\n\r\n```\r\ngraph = GraphFactory.open('conf/hadoop-graph/read-cassandra.properties')\r\ng = graph.traversal().withComputer(SparkGraphComputer)\r\ng.V().count()\r\n```\r\n\r\nLeads to this exception:\r\n\r\n```\r\njava.lang.NoSuchMethodError: com.google.common.base.Stopwatch.createStarted()Lcom/google/common/base/Stopwatch;\r\n\tat org.janusgraph.graphdb.database.idassigner.StandardIDPool.waitForIDBlockGetter(StandardIDPool.java:136)\r\n\tat org.janusgraph.graphdb.database.idassigner.StandardIDPool.close(StandardIDPool.java:229)\r\n\tat org.janusgraph.graphdb.database.idassigner.VertexIDAssigner.close(VertexIDAssigner.java:140)\r\n\tat org.janusgraph.util.system.IOUtils.closeQuietly(IOUtils.java:63)\r\n\tat org.janusgraph.graphdb.database.StandardJanusGraph.closeInternal(StandardJanusGraph.java:237)\r\n\tat org.janusgraph.graphdb.database.StandardJanusGraph.close(StandardJanusGraph.java:197)\r\n\tat org.janusgraph.hadoop.formats.util.input.current.JanusGraphHadoopSetupImpl.close(JanusGraphHadoopSetupImpl.java:118)\r\n\tat org.janusgraph.hadoop.formats.util.JanusGraphVertexDeserializer.close(JanusGraphVertexDeserializer.java:221)\r\n\tat org.janusgraph.hadoop.formats.util.GiraphInputFormat$RefCountedCloseable.release(GiraphInputFormat.java:122)\r\n\tat org.janusgraph.hadoop.formats.util.GiraphRecordReader.close(GiraphRecordReader.java:105)\r\n\tat org.apache.spark.rdd.NewHadoopRDD$$anon$1.org$apache$spark$rdd$NewHadoopRDD$$anon$$close(NewHadoopRDD.scala:244)\r\n\tat org.apache.spark.rdd.NewHadoopRDD$$anon$1.hasNext(NewHadoopRDD.scala:219)\r\n\tat org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:37)\r\n\r\n```\r\n\r\nJanusGraph is packaging Guava 18.0, but Spark 2.2.0 has Guava 14.0.1. It seems that the Spark worker is picking up the wrong Guava."},"comment":{"url":"https://api.github.com/repos/JanusGraph/janusgraph/issues/comments/428489511","html_url":"https://github.com/JanusGraph/janusgraph/issues/1159#issuecomment-428489511","issue_url":"https://api.github.com/repos/JanusGraph/janusgraph/issues/1159","id":428489511,"node_id":"MDEyOklzc3VlQ29tbWVudDQyODQ4OTUxMQ==","user":{"login":"debasishdebs","id":1013906,"node_id":"MDQ6VXNlcjEwMTM5MDY=","avatar_url":"https://avatars0.githubusercontent.com/u/1013906?v=4","gravatar_id":"","url":"https://api.github.com/users/debasishdebs","html_url":"https://github.com/debasishdebs","followers_url":"https://api.github.com/users/debasishdebs/followers","following_url":"https://api.github.com/users/debasishdebs/following{/other_user}","gists_url":"https://api.github.com/users/debasishdebs/gists{/gist_id}","starred_url":"https://api.github.com/users/debasishdebs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/debasishdebs/subscriptions","organizations_url":"https://api.github.com/users/debasishdebs/orgs","repos_url":"https://api.github.com/users/debasishdebs/repos","events_url":"https://api.github.com/users/debasishdebs/events{/privacy}","received_events_url":"https://api.github.com/users/debasishdebs/received_events","type":"User","site_admin":false},"created_at":"2018-10-10T08:45:41Z","updated_at":"2018-10-10T08:45:41Z","author_association":"CONTRIBUTOR","body":"@hxcoder65 : Few points from your comments, why are you using Spark 2.3.1 when JanusGraph 0.3.0 supports Spark 2.2.0?\r\n\r\nI don't use any spark-submit, rather used Gremlin Console to execute OLAP queries. I don't have access to the VMs where I've the env setup (Spark 2.2.0 cluster, Cassandra Cluster, ES Cluster, JG Client) so I can't verify the same now, but as far as I remembered, can you try migrating to Spark 2.2.0 and follow the docs released with JanusGraph 0.3.0 to the point, and if that still doesn't work, can you share stacktrace why that is happening?\r\n\r\nThe [docs are here!](https://docs.janusgraph.org/latest/hadoop-tp3.html) "}}
{"actor":{"display_login":"debasishdebs"}}