{"action":"created","issue":{"url":"https://api.github.com/repos/dominictarr/JSONStream/issues/101","repository_url":"https://api.github.com/repos/dominictarr/JSONStream","labels_url":"https://api.github.com/repos/dominictarr/JSONStream/issues/101/labels{/name}","comments_url":"https://api.github.com/repos/dominictarr/JSONStream/issues/101/comments","events_url":"https://api.github.com/repos/dominictarr/JSONStream/issues/101/events","html_url":"https://github.com/dominictarr/JSONStream/issues/101","id":162066394,"number":101,"title":"Node process goes out of memory while parsing large JSON files","user":{"login":"crdesai","id":1878980,"avatar_url":"https://avatars.githubusercontent.com/u/1878980?v=3","gravatar_id":"","url":"https://api.github.com/users/crdesai","html_url":"https://github.com/crdesai","followers_url":"https://api.github.com/users/crdesai/followers","following_url":"https://api.github.com/users/crdesai/following{/other_user}","gists_url":"https://api.github.com/users/crdesai/gists{/gist_id}","starred_url":"https://api.github.com/users/crdesai/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/crdesai/subscriptions","organizations_url":"https://api.github.com/users/crdesai/orgs","repos_url":"https://api.github.com/users/crdesai/repos","events_url":"https://api.github.com/users/crdesai/events{/privacy}","received_events_url":"https://api.github.com/users/crdesai/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-06-24T02:56:32Z","updated_at":"2016-06-27T17:25:23Z","closed_at":null,"body":"I am trying to parse large JSON files which are basically dump of our database in JSON format. It contains a JSON object with table names as key, and array of table data as value. I have a 200MB file and the memory goes upto 2GB, while CPU goes to 100% while processing that file. \r\nI am trying to parse the file and put the JSON objects parsed into Mongo DB database. is this supported? How can I make it work with smaller memory footprint and CPU?"},"comment":{"url":"https://api.github.com/repos/dominictarr/JSONStream/issues/comments/228814165","html_url":"https://github.com/dominictarr/JSONStream/issues/101#issuecomment-228814165","issue_url":"https://api.github.com/repos/dominictarr/JSONStream/issues/101","id":228814165,"user":{"login":"crdesai","id":1878980,"avatar_url":"https://avatars.githubusercontent.com/u/1878980?v=3","gravatar_id":"","url":"https://api.github.com/users/crdesai","html_url":"https://github.com/crdesai","followers_url":"https://api.github.com/users/crdesai/followers","following_url":"https://api.github.com/users/crdesai/following{/other_user}","gists_url":"https://api.github.com/users/crdesai/gists{/gist_id}","starred_url":"https://api.github.com/users/crdesai/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/crdesai/subscriptions","organizations_url":"https://api.github.com/users/crdesai/orgs","repos_url":"https://api.github.com/users/crdesai/repos","events_url":"https://api.github.com/users/crdesai/events{/privacy}","received_events_url":"https://api.github.com/users/crdesai/received_events","type":"User","site_admin":false},"created_at":"2016-06-27T17:25:23Z","updated_at":"2016-06-27T17:25:23Z","body":"I a not sure I understand your response. I am getting the right key and value using `JSONStream.parse(\"$*\")`. This gives the right data to retrieve. My problem is the high memory and CPU footprint. Can JSONStream release the key-value pair that has been processed already? It looks like it is keeping the whole JSON object being parsed in memory."}}
{"actor":{"display_login":"crdesai"}}