{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/790","repository_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop","labels_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/790/labels{/name}","comments_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/790/comments","events_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/790/events","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/790","id":161120617,"number":790,"title":"ES-Hive throwing exception while reading for bulk no. of columns","user":{"login":"shachouh","id":18414061,"avatar_url":"https://avatars.githubusercontent.com/u/18414061?v=3","gravatar_id":"","url":"https://api.github.com/users/shachouh","html_url":"https://github.com/shachouh","followers_url":"https://api.github.com/users/shachouh/followers","following_url":"https://api.github.com/users/shachouh/following{/other_user}","gists_url":"https://api.github.com/users/shachouh/gists{/gist_id}","starred_url":"https://api.github.com/users/shachouh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shachouh/subscriptions","organizations_url":"https://api.github.com/users/shachouh/orgs","repos_url":"https://api.github.com/users/shachouh/repos","events_url":"https://api.github.com/users/shachouh/events{/privacy}","received_events_url":"https://api.github.com/users/shachouh/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-06-20T05:41:03Z","updated_at":"2016-06-22T06:17:26Z","closed_at":"2016-06-20T14:18:08Z","body":"### What kind an issue is this?\r\n\r\nGetting exception in reading from elasticsearch through hive.\r\n\r\n\r\n### Issue description\r\n\r\nI am trying to read data from elasticsearch using hive. I have more than 400+ column in elasticsearch, need to read. And I have provided mapping for them also. But it throwing me exception.\r\nIt runs fine for less no. of columns (like 10).\r\nBelow properties I have set in create external table statement \r\n\r\nSTORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler' \r\nTBLPROPERTIES('es.nodes' = 'node:port','es.resource' ='index/type', 'es.mapping.names' = 'hivecolumns:escolumns');\r\n\r\n### Steps to reproduce\r\n\r\nCode:\r\n\r\n```\r\nTest/code snippet\r\n```\r\n\r\nStrack trace:\r\n\r\nFAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:javax.jdo.JDODataStoreException: Put request failed : INSERT INTO \"TABLE_PARAMS\" (\"PARAM_VALUE\",\"TBL_ID\",\"PARAM_KEY\") VALUES (?,?,?)\r\n        at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451)\r\n        at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:732)\r\n        at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)\r\n        at org.apache.hadoop.hive.metastore.ObjectStore.createTable(ObjectStore.java:874)\r\n        at sun.reflect.GeneratedMethodAccessor54.invoke(Unknown Source)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n        at java.lang.reflect.Method.invoke(Method.java:606)\r\n        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98)\r\n        at com.sun.proxy.$Proxy10.createTable(Unknown Source)\r\n        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1411)\r\n        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1444)\r\n        at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n        at java.lang.reflect.Method.invoke(Method.java:606)\r\n        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:133)\r\n        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99)\r\n        at com.sun.proxy.$Proxy12.create_table_with_environment_context(Unknown Source)\r\n        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:9136)\r\n        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:9120)\r\n        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)\r\n        at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)\r\n        at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)\r\n        at java.security.AccessController.doPrivileged(Native Method)\r\n        at javax.security.auth.Subject.doAs(Subject.java:415)\r\n        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)\r\n        at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)\r\n        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)\r\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n        at java.lang.Thread.run(Thread.java:745)\r\nNestedThrowablesStackTrace:\r\norg.datanucleus.store.rdbms.exceptions.MappedDatastoreException: INSERT INTO \"TABLE_PARAMS\" (\"PARAM_VALUE\",\"TBL_ID\",\"PARAM_KEY\") VALUES (?,?,?)\r\n        at org.datanucleus.store.rdbms.scostore.JoinMapStore.internalPut(JoinMapStore.java:1078)\r\n        at org.datanucleus.store.rdbms.scostore.JoinMapStore.putAll(JoinMapStore.java:220)\r\n        at org.datanucleus.store.rdbms.mapping.java.MapMapping.postInsert(MapMapping.java:137)\r\n        at org.datanucleus.store.rdbms.request.InsertRequest.execute(InsertRequest.java:519)\r\n        at org.datanucleus.store.rdbms.RDBMSPersistenceHandler.insertTable(RDBMSPersistenceHandler.java:167)\r\n        at org.datanucleus.store.rdbms.RDBMSPersistenceHandler.insertObject(RDBMSPersistenceHandler.java:143)\r\n        at org.datanucleus.state.JDOStateManager.internalMakePersistent(JDOStateManager.java:3784)\r\n        at org.datanucleus.state.JDOStateManager.makePersistent(JDOStateManager.java:3760)\r\n        at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:2219)\r\n        at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:2065)\r\n        at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:1913)\r\n        at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:217)\r\n        at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:727)\r\n        at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:752)\r\n        at org.apache.hadoop.hive.metastore.ObjectStore.createTable(ObjectStore.java:874)\r\n        at sun.reflect.GeneratedMethodAccessor54.invoke(Unknown Source)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n        at java.lang.reflect.Method.invoke(Method.java:606)\r\n        at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98)\r\n        at com.sun.proxy.$Proxy10.createTable(Unknown Source)\r\n        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1411)\r\n        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1444)\r\n        at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n        at java.lang.reflect.Method.invoke(Method.java:606)\r\n        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:133)\r\n        at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99)\r\n        at com.sun.proxy.$Proxy12.create_table_with_environment_context(Unknown Source)\r\n        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:9136)\r\n        at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:9120)\r\n        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)\r\n        at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110)\r\n        at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106)\r\n        at java.security.AccessController.doPrivileged(Native Method)\r\n        at javax.security.auth.Subject.doAs(Subject.java:415)\r\n        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)\r\n        at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118)\r\n        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)\r\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n        at java.lang.Thread.run(Thread.java:745)\r\nCaused by: org.postgresql.util.PSQLException: ERROR: value too long for type character varying(4000)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2102)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1835)\r\n        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:500)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:388)\r\n        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:334)\r\n        at com.jolbox.bonecp.PreparedStatementHandle.executeUpdate(PreparedStatementHandle.java:205)\r\n        at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeUpdate(ParamLoggingPreparedStatement.java:399)\r\n        at org.datanucleus.store.rdbms.SQLController.executeStatementUpdate(SQLController.java:439)\r\n        at org.datanucleus.store.rdbms.scostore.JoinMapStore.internalPut(JoinMapStore.java:1069)\r\n        ... 40 more\r\n)\r\n\r\n### Version Info\r\n\r\nES-Hadoop   :  elasticsearch-hadoop-2.0.1.jar ; elasticsearch-hadoop-hive-2.0.1-sources.jar;\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/comments/227653527","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/790#issuecomment-227653527","issue_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/790","id":227653527,"user":{"login":"shachouh","id":18414061,"avatar_url":"https://avatars.githubusercontent.com/u/18414061?v=3","gravatar_id":"","url":"https://api.github.com/users/shachouh","html_url":"https://github.com/shachouh","followers_url":"https://api.github.com/users/shachouh/followers","following_url":"https://api.github.com/users/shachouh/following{/other_user}","gists_url":"https://api.github.com/users/shachouh/gists{/gist_id}","starred_url":"https://api.github.com/users/shachouh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shachouh/subscriptions","organizations_url":"https://api.github.com/users/shachouh/orgs","repos_url":"https://api.github.com/users/shachouh/repos","events_url":"https://api.github.com/users/shachouh/events{/privacy}","received_events_url":"https://api.github.com/users/shachouh/received_events","type":"User","site_admin":false},"created_at":"2016-06-22T06:17:26Z","updated_at":"2016-06-22T06:17:26Z","body":"@jbaiera  Thanks "}}
{"actor":{"display_login":"shachouh"}}