{"action":"created","issue":{"url":"https://api.github.com/repos/ropensci/jqr/issues/51","repository_url":"https://api.github.com/repos/ropensci/jqr","labels_url":"https://api.github.com/repos/ropensci/jqr/issues/51/labels{/name}","comments_url":"https://api.github.com/repos/ropensci/jqr/issues/51/comments","events_url":"https://api.github.com/repos/ropensci/jqr/issues/51/events","html_url":"https://github.com/ropensci/jqr/issues/51","id":196967965,"number":51,"title":"Read from connection","user":{"login":"noamross","id":571752,"avatar_url":"https://avatars.githubusercontent.com/u/571752?v=3","gravatar_id":"","url":"https://api.github.com/users/noamross","html_url":"https://github.com/noamross","followers_url":"https://api.github.com/users/noamross/followers","following_url":"https://api.github.com/users/noamross/following{/other_user}","gists_url":"https://api.github.com/users/noamross/gists{/gist_id}","starred_url":"https://api.github.com/users/noamross/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/noamross/subscriptions","organizations_url":"https://api.github.com/users/noamross/orgs","repos_url":"https://api.github.com/users/noamross/repos","events_url":"https://api.github.com/users/noamross/events{/privacy}","received_events_url":"https://api.github.com/users/noamross/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2016-12-21T15:59:12Z","updated_at":"2016-12-23T04:15:08Z","closed_at":null,"body":"It would be nice to be able to run a jq pipe from a connection (such as a URL, file or fifo), so that one can avoid loading all the JSON into memory.  \r\n\r\nI note that jq 1.5 has [additional streaming options](https://stedolan.github.io/jq/manual/v1.5/#Streaming), including allows for to output in ndjson format, which means that one would be able to run JQ on large JSON, and pipe it to `jsonlite::stream_in`."},"comment":{"url":"https://api.github.com/repos/ropensci/jqr/issues/comments/268938429","html_url":"https://github.com/ropensci/jqr/issues/51#issuecomment-268938429","issue_url":"https://api.github.com/repos/ropensci/jqr/issues/51","id":268938429,"user":{"login":"noamross","id":571752,"avatar_url":"https://avatars.githubusercontent.com/u/571752?v=3","gravatar_id":"","url":"https://api.github.com/users/noamross","html_url":"https://github.com/noamross","followers_url":"https://api.github.com/users/noamross/followers","following_url":"https://api.github.com/users/noamross/following{/other_user}","gists_url":"https://api.github.com/users/noamross/gists{/gist_id}","starred_url":"https://api.github.com/users/noamross/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/noamross/subscriptions","organizations_url":"https://api.github.com/users/noamross/orgs","repos_url":"https://api.github.com/users/noamross/repos","events_url":"https://api.github.com/users/noamross/events{/privacy}","received_events_url":"https://api.github.com/users/noamross/received_events","type":"User","site_admin":false},"created_at":"2016-12-23T04:15:08Z","updated_at":"2016-12-23T04:15:08Z","body":"Thanks. Yes, the problem is the JSON is biggish (~1GB), and the goal of the\npackage is to get data into the hands of people who may not have the best\ncomputers with much memory. But ATM I'm having some success getting our\ndata providers to switch to ndjson, so no urgency - gonna stream in the\ndata, reduce and store locally.\n\nOn Thu, Dec 22, 2016, 1:04 PM Scott Chamberlain <notifications@github.com>\nwrote:\n\n> yeah\n>\n> —\n> You are receiving this because you were mentioned.\n> Reply to this email directly, view it on GitHub\n> <https://github.com/ropensci/jqr/issues/51#issuecomment-268856040>, or mute\n> the thread\n> <https://github.com/notifications/unsubscribe-auth/AAi5aC5Ff6-oRoXvN1UQzGWNQ2N_hIWPks5rKruQgaJpZM4LTGJj>\n> .\n>\n"}}
{"actor":{"display_login":"noamross"}}