{"action":"created","issue":{"url":"https://api.github.com/repos/apache/incubator-carbondata/issues/111","repository_url":"https://api.github.com/repos/apache/incubator-carbondata","labels_url":"https://api.github.com/repos/apache/incubator-carbondata/issues/111/labels{/name}","comments_url":"https://api.github.com/repos/apache/incubator-carbondata/issues/111/comments","events_url":"https://api.github.com/repos/apache/incubator-carbondata/issues/111/events","html_url":"https://github.com/apache/incubator-carbondata/pull/111","id":174194887,"number":111,"title":"[CARBONDATA-194] ArrayIndexOfBoundException thrown when number of columns in row more than the max number of columns in univocity parser settings","user":{"login":"manishgupta88","id":12965647,"avatar_url":"https://avatars.githubusercontent.com/u/12965647?v=3","gravatar_id":"","url":"https://api.github.com/users/manishgupta88","html_url":"https://github.com/manishgupta88","followers_url":"https://api.github.com/users/manishgupta88/followers","following_url":"https://api.github.com/users/manishgupta88/following{/other_user}","gists_url":"https://api.github.com/users/manishgupta88/gists{/gist_id}","starred_url":"https://api.github.com/users/manishgupta88/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/manishgupta88/subscriptions","organizations_url":"https://api.github.com/users/manishgupta88/orgs","repos_url":"https://api.github.com/users/manishgupta88/repos","events_url":"https://api.github.com/users/manishgupta88/events{/privacy}","received_events_url":"https://api.github.com/users/manishgupta88/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-08-31T06:30:11Z","updated_at":"2016-08-31T08:43:27Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/incubator-carbondata/pulls/111","html_url":"https://github.com/apache/incubator-carbondata/pull/111","diff_url":"https://github.com/apache/incubator-carbondata/pull/111.diff","patch_url":"https://github.com/apache/incubator-carbondata/pull/111.patch"},"body":"ISSUE ID: https://issues.apache.org/jira/browse/CARBONDATA-194\r\n\r\nProblem: When the number of columns in CSV data file while parsing a row are more than the max number of columns configured in the univocity parser settings, the parser throws array index of bound exception\r\n\r\nReason: Max number of columns in CSVParserSettings are set equivalent to the number of columns in schema with an addition of 10. if still the number of columns while parsing are more then the univocity parser throws array index of bound exception.\r\n\r\nSolution: Configure a higher value for max number of columns and take the max of number of columns in schema and default max columns value while setting in univocity parser settings.\r\n\r\nImpact: Data load flow"},"comment":{"url":"https://api.github.com/repos/apache/incubator-carbondata/issues/comments/243698378","html_url":"https://github.com/apache/incubator-carbondata/pull/111#issuecomment-243698378","issue_url":"https://api.github.com/repos/apache/incubator-carbondata/issues/111","id":243698378,"user":{"login":"manishgupta88","id":12965647,"avatar_url":"https://avatars.githubusercontent.com/u/12965647?v=3","gravatar_id":"","url":"https://api.github.com/users/manishgupta88","html_url":"https://github.com/manishgupta88","followers_url":"https://api.github.com/users/manishgupta88/followers","following_url":"https://api.github.com/users/manishgupta88/following{/other_user}","gists_url":"https://api.github.com/users/manishgupta88/gists{/gist_id}","starred_url":"https://api.github.com/users/manishgupta88/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/manishgupta88/subscriptions","organizations_url":"https://api.github.com/users/manishgupta88/orgs","repos_url":"https://api.github.com/users/manishgupta88/repos","events_url":"https://api.github.com/users/manishgupta88/events{/privacy}","received_events_url":"https://api.github.com/users/manishgupta88/received_events","type":"User","site_admin":false},"created_at":"2016-08-31T08:43:27Z","updated_at":"2016-08-31T08:43:27Z","body":"@gvramana \r\n1. Array creation will happen only one time for the size specified and every time data will be filled and read from that array. So looking at parsing code I dont think there will be any impact on reading performance.\r\n2. If we dont set this option in univocity parser settings, then max columns will have a default value of 512."}}
{"actor":{"display_login":"manishgupta88"}}