{"action":"created","issue":{"url":"https://api.github.com/repos/databricks/tensorframes/issues/56","repository_url":"https://api.github.com/repos/databricks/tensorframes","labels_url":"https://api.github.com/repos/databricks/tensorframes/issues/56/labels{/name}","comments_url":"https://api.github.com/repos/databricks/tensorframes/issues/56/comments","events_url":"https://api.github.com/repos/databricks/tensorframes/issues/56/events","html_url":"https://github.com/databricks/tensorframes/issues/56","id":172418236,"number":56,"title":"NoClassDefFoundError: org/apache/spark/Logging","user":{"login":"kumarmsingh","id":20281449,"avatar_url":"https://avatars.githubusercontent.com/u/20281449?v=3","gravatar_id":"","url":"https://api.github.com/users/kumarmsingh","html_url":"https://github.com/kumarmsingh","followers_url":"https://api.github.com/users/kumarmsingh/followers","following_url":"https://api.github.com/users/kumarmsingh/following{/other_user}","gists_url":"https://api.github.com/users/kumarmsingh/gists{/gist_id}","starred_url":"https://api.github.com/users/kumarmsingh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kumarmsingh/subscriptions","organizations_url":"https://api.github.com/users/kumarmsingh/orgs","repos_url":"https://api.github.com/users/kumarmsingh/repos","events_url":"https://api.github.com/users/kumarmsingh/events{/privacy}","received_events_url":"https://api.github.com/users/kumarmsingh/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-08-22T10:26:50Z","updated_at":"2016-12-20T21:12:11Z","closed_at":null,"body":"I am trying to run sample code with $pyspark --packages databricks:tensorframes:0.2.3-s_2.10\nI am getting this error (below attached) with spark-1.6, spark-2.0 and custom build on spark with branch-2.0.\nI tried to find org.apache.spark.logging jar, which I am unable to find anywhere. \nI am using Mac OS ElCapitain. \n## Please help.\n\nPy4JJavaError                             Traceback (most recent call last)\n<ipython-input-1-4798ad5f3b2e> in <module>()\n      8     # The TensorFlow placeholder that corresponds to column 'x'.\n      9     # The shape of the placeholder is automatically inferred from the DataFrame.\n---> 10     x = tfs.block(df, \"x\")\n     11     # The output that adds 3 to x\n     12     z = tf.add(x, 3, name='z')\n\n/private/var/folders/_f/fzxfs9dj33j0381wvy5bdsdm0000gn/T/spark-1831a94f-7cdd-4691-a32a-4cbc3d9bc3a5/userFiles-66cd46aa-619d-41cf-806d-3dc6e509e13d/databricks_tensorframes-0.2.3-s_2.10.jar/tensorframes/core.py in block(df, col_name, tf_name)\n    313     :return: a TensorFlow placeholder.\n    314     \"\"\"\n--> 315     return _auto_placeholder(df, col_name, tf_name, block = True)\n    316 \n    317 def row(df, col_name, tf_name = None):\n\n/private/var/folders/_f/fzxfs9dj33j0381wvy5bdsdm0000gn/T/spark-1831a94f-7cdd-4691-a32a-4cbc3d9bc3a5/userFiles-66cd46aa-619d-41cf-806d-3dc6e509e13d/databricks_tensorframes-0.2.3-s_2.10.jar/tensorframes/core.py in _auto_placeholder(df, col_name, tf_name, block)\n    331 \n    332 def _auto_placeholder(df, col_name, tf_name, block):\n--> 333     info = _java_api().extra_schema_info(df._jdf)\n    334     col_shape = [x.shape() for x in info if x.fieldName() == col_name]\n    335     if len(col_shape) == 0:\n\n/private/var/folders/_f/fzxfs9dj33j0381wvy5bdsdm0000gn/T/spark-1831a94f-7cdd-4691-a32a-4cbc3d9bc3a5/userFiles-66cd46aa-619d-41cf-806d-3dc6e509e13d/databricks_tensorframes-0.2.3-s_2.10.jar/tensorframes/core.py in _java_api()\n     28     # You cannot simply call the creation of the the class on the _jvm due to classloader issues\n     29     # with Py4J.\n---> 30     return _jvm.Thread.currentThread().getContextClassLoader().loadClass(javaClassName) \\\n     31         .newInstance()\n     32 \n\n/usr/local/spark/python/lib/py4j-0.10.1-src.zip/py4j/java_gateway.py in **call**(self, *args)\n    931         answer = self.gateway_client.send_command(command)\n    932         return_value = get_return_value(\n--> 933             answer, self.gateway_client, self.target_id, self.name)\n    934 \n    935         for temp_arg in temp_args:\n\n/usr/local/spark/python/pyspark/sql/utils.pyc in deco(_a, *_kw)\n     61     def deco(_a, *_kw):\n     62         try:\n---> 63             return f(_a, *_kw)\n     64         except py4j.protocol.Py4JJavaError as e:\n     65             s = e.java_exception.toString()\n\n/usr/local/spark/python/lib/py4j-0.10.1-src.zip/py4j/protocol.py in get_return_value(answer, gateway_client, target_id, name)\n    310                 raise Py4JJavaError(\n    311                     \"An error occurred while calling {0}{1}{2}.\\n\".\n--> 312                     format(target_id, \".\", name), value)\n    313             else:\n    314                 raise Py4JError(\n\nPy4JJavaError: An error occurred while calling o41.loadClass.\n: java.lang.NoClassDefFoundError: org/apache/spark/Logging\n    at java.lang.ClassLoader.defineClass1(Native Method)\n    at java.lang.ClassLoader.defineClass(ClassLoader.java:800)\n    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)\n    at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)\n    at java.net.URLClassLoader.access$100(URLClassLoader.java:71)\n    at java.net.URLClassLoader$1.run(URLClassLoader.java:361)\n    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)\n    at java.security.AccessController.doPrivileged(Native Method)\n    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)\n    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)\n    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)\n    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\n    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n    at java.lang.reflect.Method.invoke(Method.java:606)\n    at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:237)\n    at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)\n    at py4j.Gateway.invoke(Gateway.java:280)\n    at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:128)\n    at py4j.commands.CallCommand.execute(CallCommand.java:79)\n    at py4j.GatewayConnection.run(GatewayConnection.java:211)\n    at java.lang.Thread.run(Thread.java:745)\nCaused by: java.lang.ClassNotFoundException: org.apache.spark.Logging\n    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)\n    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)\n    at java.security.AccessController.doPrivileged(Native Method)\n    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)\n    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)\n    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)\n    ... 22 more\n"},"comment":{"url":"https://api.github.com/repos/databricks/tensorframes/issues/comments/268360957","html_url":"https://github.com/databricks/tensorframes/issues/56#issuecomment-268360957","issue_url":"https://api.github.com/repos/databricks/tensorframes/issues/56","id":268360957,"user":{"login":"yanji84","id":131415,"avatar_url":"https://avatars.githubusercontent.com/u/131415?v=3","gravatar_id":"","url":"https://api.github.com/users/yanji84","html_url":"https://github.com/yanji84","followers_url":"https://api.github.com/users/yanji84/followers","following_url":"https://api.github.com/users/yanji84/following{/other_user}","gists_url":"https://api.github.com/users/yanji84/gists{/gist_id}","starred_url":"https://api.github.com/users/yanji84/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yanji84/subscriptions","organizations_url":"https://api.github.com/users/yanji84/orgs","repos_url":"https://api.github.com/users/yanji84/repos","events_url":"https://api.github.com/users/yanji84/events{/privacy}","received_events_url":"https://api.github.com/users/yanji84/received_events","type":"User","site_admin":false},"created_at":"2016-12-20T21:12:11Z","updated_at":"2016-12-20T21:12:11Z","body":"Any update on this issue?\r\n\r\nIt seems that this exception is due to the fact that org/apache/spark/Logging class has been removed from Spark since 1.5.2. Is there any reason why tensorframe is taking a dependency on this library?\r\n\r\nInclude the stackoverflow link that explains the issue:\r\n\r\nhttp://stackoverflow.com/questions/40287289/java-lang-noclassdeffounderror-org-apache-spark-logging"}}
{"actor":{"display_login":"yanji84"}}