{"action":"created","issue":{"url":"https://api.github.com/repos/Keyang/node-csvtojson/issues/232","repository_url":"https://api.github.com/repos/Keyang/node-csvtojson","labels_url":"https://api.github.com/repos/Keyang/node-csvtojson/issues/232/labels{/name}","comments_url":"https://api.github.com/repos/Keyang/node-csvtojson/issues/232/comments","events_url":"https://api.github.com/repos/Keyang/node-csvtojson/issues/232/events","html_url":"https://github.com/Keyang/node-csvtojson/issues/232","id":287485161,"number":232,"title":"Row has mixed data from other row","user":{"login":"Fire-Brand","id":8603744,"avatar_url":"https://avatars2.githubusercontent.com/u/8603744?v=4","gravatar_id":"","url":"https://api.github.com/users/Fire-Brand","html_url":"https://github.com/Fire-Brand","followers_url":"https://api.github.com/users/Fire-Brand/followers","following_url":"https://api.github.com/users/Fire-Brand/following{/other_user}","gists_url":"https://api.github.com/users/Fire-Brand/gists{/gist_id}","starred_url":"https://api.github.com/users/Fire-Brand/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Fire-Brand/subscriptions","organizations_url":"https://api.github.com/users/Fire-Brand/orgs","repos_url":"https://api.github.com/users/Fire-Brand/repos","events_url":"https://api.github.com/users/Fire-Brand/events{/privacy}","received_events_url":"https://api.github.com/users/Fire-Brand/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-01-10T15:59:32Z","updated_at":"2018-02-15T11:48:48Z","closed_at":"2018-02-15T11:48:48Z","author_association":"NONE","body":"I have a large CSV file (~3M rows), and trying to stream that file from S3 and parsing the data causes something strange to happen:\r\n\r\nsay i have 2 rows(they aren't one right after the other)\r\nrow num **689**: `\"CdComics\",\"12345\",\"The_Duck_Knight_5.50\",\"boogle.com\",\"\",\"324,546\",\"$15.76\",\"15\",\"750\"`\r\nrow num **16592**: `\"GimKarries\",\"98765\",\"Me_Myself_And_es6_7.30\",\"\",\"youpork.com\",\"1,380\",\"$722.032\",\"0\",\"29,900\"`\r\n\r\n(yes, some columns are somtimes empty, some numbers have `','` inside of them, and all columns are surrounded by double quotes)\r\n\r\nWhen i read data (no matter if its 'csv' event or 'data' or 'json') at some point few of the rows get mixed up in different ways, for example (using the example above):\r\n\r\n```javascript\r\n[ \r\n  'CdComics',\r\n  '12345',\r\n  'The_Duck_Knight_5.50',\r\n  'Me_Myself_And_es6_7.30',\r\n  '',\r\n  'youpork.com',\r\n  '1,380',\r\n  '$722.032',\r\n  '0',\r\n  '29,900'\r\n]\r\n```\r\nMy params are set like so:\r\n```javascript\r\n{\r\n    workerNum: 4,\r\n    constructResult: false,\r\n    maxRowLength: 65535\r\n}\r\n```\r\n\r\nAny idea why this would happen and how i can fix that?\r\n\r\nP.S: i have no control over the CSV file and it's content, if i open it with a text editor everything looks Normal(like the 2 rows above)\r\n"},"comment":{"url":"https://api.github.com/repos/Keyang/node-csvtojson/issues/comments/365904288","html_url":"https://github.com/Keyang/node-csvtojson/issues/232#issuecomment-365904288","issue_url":"https://api.github.com/repos/Keyang/node-csvtojson/issues/232","id":365904288,"user":{"login":"Fire-Brand","id":8603744,"avatar_url":"https://avatars2.githubusercontent.com/u/8603744?v=4","gravatar_id":"","url":"https://api.github.com/users/Fire-Brand","html_url":"https://github.com/Fire-Brand","followers_url":"https://api.github.com/users/Fire-Brand/followers","following_url":"https://api.github.com/users/Fire-Brand/following{/other_user}","gists_url":"https://api.github.com/users/Fire-Brand/gists{/gist_id}","starred_url":"https://api.github.com/users/Fire-Brand/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Fire-Brand/subscriptions","organizations_url":"https://api.github.com/users/Fire-Brand/orgs","repos_url":"https://api.github.com/users/Fire-Brand/repos","events_url":"https://api.github.com/users/Fire-Brand/events{/privacy}","received_events_url":"https://api.github.com/users/Fire-Brand/received_events","type":"User","site_admin":false},"created_at":"2018-02-15T11:48:48Z","updated_at":"2018-02-15T11:48:48Z","author_association":"NONE","body":"Changed to parsing from local file.\r\nparing form a stream wasn't working for my case."}}
{"actor":{"display_login":"Fire-Brand"}}