{"action":"opened","issue":{"url":"https://api.github.com/repos/rcongiu/Hive-JSON-Serde/issues/146","repository_url":"https://api.github.com/repos/rcongiu/Hive-JSON-Serde","labels_url":"https://api.github.com/repos/rcongiu/Hive-JSON-Serde/issues/146/labels{/name}","comments_url":"https://api.github.com/repos/rcongiu/Hive-JSON-Serde/issues/146/comments","events_url":"https://api.github.com/repos/rcongiu/Hive-JSON-Serde/issues/146/events","html_url":"https://github.com/rcongiu/Hive-JSON-Serde/issues/146","id":155436260,"number":146,"title":"org.openx.data.udf.JsonUDF throwing exception","user":{"login":"shruthb","id":3615562,"avatar_url":"https://avatars.githubusercontent.com/u/3615562?v=3","gravatar_id":"","url":"https://api.github.com/users/shruthb","html_url":"https://github.com/shruthb","followers_url":"https://api.github.com/users/shruthb/followers","following_url":"https://api.github.com/users/shruthb/following{/other_user}","gists_url":"https://api.github.com/users/shruthb/gists{/gist_id}","starred_url":"https://api.github.com/users/shruthb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shruthb/subscriptions","organizations_url":"https://api.github.com/users/shruthb/orgs","repos_url":"https://api.github.com/users/shruthb/repos","events_url":"https://api.github.com/users/shruthb/events{/privacy}","received_events_url":"https://api.github.com/users/shruthb/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2016-05-18T07:44:08Z","updated_at":"2016-05-18T07:44:08Z","closed_at":null,"body":"steps done on hive shell :\r\n```\r\n> add jar json-udf-1.3.8-jar-with-dependencies.jar;\r\n> create temporary function tjson as 'org.openx.data.udf.JsonUDF';\r\n> insert overwrite table interim_3 select userId, tjson(features) from interim_2;\r\n```\r\n\r\ninfo about tables :\r\n```\r\n> describe interim_2\r\nOK\r\nuserid                  string                                      \r\nfeatures                array<string>                               \r\nTime taken: 0.065 seconds, Fetched: 2 row(s)\r\n> describe interim_3\r\nOK\r\nuserid                  string                                      \r\nfeatures               string                               \r\nTime taken: 0.065 seconds, Fetched: 2 row(s)\r\n```\r\n\r\nError : \r\n```\r\nQuery ID = hadoop_20160518073535_c81311a0-39ec-4c5e-bee3-c0574d6e68fe\r\nTotal jobs = 3\r\nLaunching Job 1 out of 3\r\nNumber of reduce tasks is set to 0 since there's no reduce operator\r\nStarting Job = job_1463552240367_0007, Tracking URL = http://ip-172-31-17-151.ec2.internal:20888/proxy/application_1463552240367_0007/\r\nKill Command = /usr/lib/hadoop/bin/hadoop job  -kill job_1463552240367_0007\r\nHadoop job information for Stage-1: number of mappers: 1; number of reducers: 0\r\n2016-05-18 07:35:48,819 Stage-1 map = 0%,  reduce = 0%\r\n2016-05-18 07:36:11,640 Stage-1 map = 100%,  reduce = 0%\r\nEnded Job = job_1463552240367_0007 with errors\r\nError during job, obtaining debugging information...\r\nExamining task ID: task_1463552240367_0007_m_000000 (and more) from job job_1463552240367_0007\r\n\r\nTask with the most failures(4): \r\n-----\r\nTask ID:\r\n  task_1463552240367_0007_m_000000\r\n\r\nURL:\r\n  http://ip-172-31-17-151.ec2.internal:8088/taskdetails.jsp?jobid=job_1463552240367_0007&tipid=task_1463552240367_0007_m_000000\r\n-----\r\nDiagnostic Messages for this Task:\r\nError: java.lang.RuntimeException: org.apache.hive.com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException\r\nSerialization trace:\r\ncolumnNames (org.openx.data.jsonserde.JsonSerDe)\r\nserde (org.openx.data.udf.JsonUDF)\r\ngenericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc)\r\ncolExprMap (org.apache.hadoop.hive.ql.exec.SelectOperator)\r\nchildOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)\r\naliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)\r\n        at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:426)\r\n        at org.apache.hadoop.hive.ql.exec.Utilities.getMapWork(Utilities.java:289)\r\n        at org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:261)\r\n        at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:489)\r\n        at org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:482)\r\n        at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:658)\r\n        at org.apache.hadoop.mapred.MapTask$TrackedRecordReader.<init>(MapTask.java:170)\r\n        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:433)\r\n        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:344)\r\n        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:172)\r\n        at java.security.AccessController.doPrivileged(Native Method)\r\n        at javax.security.auth.Subject.doAs(Subject.java:415)\r\n        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)\r\n        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:166)\r\nCaused by: org.apache.hive.com.esotericsoftware.kryo.KryoException: java.lang.NullPointerException\r\nSerialization trace:\r\ncolumnNames (org.openx.data.jsonserde.JsonSerDe)\r\nserde (org.openx.data.udf.JsonUDF)\r\ngenericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc)\r\ncolExprMap (org.apache.hadoop.hive.ql.exec.SelectOperator)\r\nchildOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)\r\naliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:125)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:139)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:17)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:112)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:776)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:139)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:17)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:507)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:672)\r\n        at org.apache.hadoop.hive.ql.exec.Utilities.deserializeObjectByKryo(Utilities.java:1028)\r\n        at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:936)\r\n        at org.apache.hadoop.hive.ql.exec.Utilities.deserializePlan(Utilities.java:950)\r\n        at org.apache.hadoop.hive.ql.exec.Utilities.getBaseWork(Utilities.java:393)\r\n        ... 13 more\r\nCaused by: java.lang.NullPointerException\r\n        at java.util.Arrays$ArrayList.size(Arrays.java:2847)\r\n        at java.util.AbstractList.add(AbstractList.java:108)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:105)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:18)\r\n        at org.apache.hive.com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:694)\r\n        at org.apache.hive.com.esotericsoftware.kryo.serializers.ObjectField.read(ObjectField.java:106)\r\n        ... 43 more\r\n\r\n```"}}