{"action":"created","issue":{"url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds/issues/14","repository_url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds","labels_url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds/issues/14/labels{/name}","comments_url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds/issues/14/comments","events_url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds/issues/14/events","html_url":"https://github.com/ZuInnoTe/spark-hadoopoffice-ds/issues/14","id":325228314,"number":14,"title":"Getting NegativeArraySizeException while reading xls/xlsx format - not in all files","user":{"login":"jaypanchal","id":17511552,"avatar_url":"https://avatars1.githubusercontent.com/u/17511552?v=4","gravatar_id":"","url":"https://api.github.com/users/jaypanchal","html_url":"https://github.com/jaypanchal","followers_url":"https://api.github.com/users/jaypanchal/followers","following_url":"https://api.github.com/users/jaypanchal/following{/other_user}","gists_url":"https://api.github.com/users/jaypanchal/gists{/gist_id}","starred_url":"https://api.github.com/users/jaypanchal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jaypanchal/subscriptions","organizations_url":"https://api.github.com/users/jaypanchal/orgs","repos_url":"https://api.github.com/users/jaypanchal/repos","events_url":"https://api.github.com/users/jaypanchal/events{/privacy}","received_events_url":"https://api.github.com/users/jaypanchal/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":14,"created_at":"2018-05-22T10:15:01Z","updated_at":"2018-05-23T07:32:45Z","closed_at":null,"author_association":"NONE","body":"It's not happening with every file for excel but for some files, i am getting NegativeArraySizeException while reading specific worksheet.\r\n```\r\njava.lang.NegativeArraySizeException\r\n\tat org.zuinnote.hadoop.office.format.common.parser.MSExcelParser.getNext(MSExcelParser.java:433)\r\n\tat org.zuinnote.hadoop.office.format.common.OfficeReader.getNext(OfficeReader.java:127)\r\n\tat org.zuinnote.hadoop.office.format.mapreduce.ExcelRecordReader.nextKeyValue(ExcelRecordReader.java:89)\r\n\tat org.apache.spark.sql.execution.datasources.RecordReaderIterator.hasNext(RecordReaderIterator.scala:39)\r\n\tat org.zuinnote.spark.office.excel.HadoopFileExcelReader.hasNext(HadoopFileExcelReader.scala:61)\r\n\tat scala.collection.Iterator$class.foreach(Iterator.scala:893)\r\n\tat org.zuinnote.spark.office.excel.HadoopFileExcelReader.foreach(HadoopFileExcelReader.scala:44)\r\n\tat org.zuinnote.spark.office.excel.DefaultSource.inferSchema(DefaultSource.scala:183)\r\n\tat org.apache.spark.sql.execution.datasources.DataSource$$anonfun$8.apply(DataSource.scala:202)\r\n\tat org.apache.spark.sql.execution.datasources.DataSource$$anonfun$8.apply(DataSource.scala:202)\r\n\tat scala.Option.orElse(Option.scala:289)\r\n\tat org.apache.spark.sql.execution.datasources.DataSource.getOrInferFileFormatSchema(DataSource.scala:201)\r\n\tat org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:392)\r\n\tat org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:239)\r\n\tat org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:227)\r\n\tat org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:174)\r\n```"},"comment":{"url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds/issues/comments/391249280","html_url":"https://github.com/ZuInnoTe/spark-hadoopoffice-ds/issues/14#issuecomment-391249280","issue_url":"https://api.github.com/repos/ZuInnoTe/spark-hadoopoffice-ds/issues/14","id":391249280,"user":{"login":"jornfranke","id":1659364,"avatar_url":"https://avatars0.githubusercontent.com/u/1659364?v=4","gravatar_id":"","url":"https://api.github.com/users/jornfranke","html_url":"https://github.com/jornfranke","followers_url":"https://api.github.com/users/jornfranke/followers","following_url":"https://api.github.com/users/jornfranke/following{/other_user}","gists_url":"https://api.github.com/users/jornfranke/gists{/gist_id}","starred_url":"https://api.github.com/users/jornfranke/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jornfranke/subscriptions","organizations_url":"https://api.github.com/users/jornfranke/orgs","repos_url":"https://api.github.com/users/jornfranke/repos","events_url":"https://api.github.com/users/jornfranke/events{/privacy}","received_events_url":"https://api.github.com/users/jornfranke/received_events","type":"User","site_admin":false},"created_at":"2018-05-23T07:32:45Z","updated_at":"2018-05-23T07:32:45Z","author_association":"MEMBER","body":"Keep in mind that you also need to increase the hadoopoffice dependency to 1.1.1\n\n> On 23. May 2018, at 09:28, Jay Panchal <notifications@github.com> wrote:\n> \n> @jornfranke\n> Build is getting failed... Can you please assist me to solve this issue...\n> \n> $ sbt assembly [info] Loading settings from plugins.sbt,assembly.sbt ... [info] Loading project definition from /home/jay/Desktop/Excel_lib/New/spark-hadoopoffice-ds-master/project [info] Loading settings from build.sbt ... [info] Set current project to spark-hadoopoffice-ds (in build file:/home/jay/Desktop/Excel_lib/New/spark-hadoopoffice-ds-master/) [info] Updating ... [warn] module not found: org.apache.spark#spark-core_2.12;2.0.1 [warn] ==== local: tried [warn] /home/jay/.ivy2/local/org.apache.spark/spark-core_2.12/2.0.1/ivys/ivy.xml [warn] ==== public: tried [warn] https://repo1.maven.org/maven2/org/apache/spark/spark-core_2.12/2.0.1/spark-core_2.12-2.0.1.pom [warn] ==== local-preloaded-ivy: tried [warn] /home/jay/.sbt/preloaded/org.apache.spark/spark-core_2.12/2.0.1/ivys/ivy.xml [warn] ==== local-preloaded: tried [warn] file:////home/jay/.sbt/preloaded/org/apache/spark/spark-core_2.12/2.0.1/spark-core_2.12-2.0.1.pom [warn] ==== Maven2 Local: tried [warn] file:/home/jay/.m2/repository/org/apache/spark/spark-core_2.12/2.0.1/spark-core_2.12-2.0.1.pom [warn] module not found: org.apache.spark#spark-sql_2.12;2.0.1 [warn] ==== local: tried [warn] /home/jay/.ivy2/local/org.apache.spark/spark-sql_2.12/2.0.1/ivys/ivy.xml [warn] ==== public: tried [warn] https://repo1.maven.org/maven2/org/apache/spark/spark-sql_2.12/2.0.1/spark-sql_2.12-2.0.1.pom [warn] ==== local-preloaded-ivy: tried [warn] /home/jay/.sbt/preloaded/org.apache.spark/spark-sql_2.12/2.0.1/ivys/ivy.xml [warn] ==== local-preloaded: tried [warn] file:////home/jay/.sbt/preloaded/org/apache/spark/spark-sql_2.12/2.0.1/spark-sql_2.12-2.0.1.pom [warn] ==== Maven2 Local: tried [warn] file:/home/jay/.m2/repository/org/apache/spark/spark-sql_2.12/2.0.1/spark-sql_2.12-2.0.1.pom [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: UNRESOLVED DEPENDENCIES :: [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] :: org.apache.spark#spark-core_2.12;2.0.1: not found [warn] :: org.apache.spark#spark-sql_2.12;2.0.1: not found [warn] :::::::::::::::::::::::::::::::::::::::::::::: [warn] [warn] Note: Unresolved dependencies path: [warn] org.apache.spark:spark-core_2.12:2.0.1 (/home/jay/Desktop/Excel_lib/New/spark-hadoopoffice-ds-master/build.sbt#L36-37) [warn] +- com.github.zuinnote:spark-hadoopoffice-ds_2.12:1.1.1 [warn] org.apache.spark:spark-sql_2.12:2.0.1 (/home/jay/Desktop/Excel_lib/New/spark-hadoopoffice-ds-master/build.sbt#L38-39) [warn] +- com.github.zuinnote:spark-hadoopoffice-ds_2.12:1.1.1 [error] sbt.librarymanagement.ResolveException: unresolved dependency: org.apache.spark#spark-core_2.12;2.0.1: not found [error] unresolved dependency: org.apache.spark#spark-sql_2.12;2.0.1: not found\n> \n> —\n> You are receiving this because you were mentioned.\n> Reply to this email directly, view it on GitHub, or mute the thread.\n"}}
{"actor":{"display_login":"jornfranke"}}