{"action":"created","issue":{"url":"https://api.github.com/repos/hellonarrativ/spectrify/issues/7","repository_url":"https://api.github.com/repos/hellonarrativ/spectrify","labels_url":"https://api.github.com/repos/hellonarrativ/spectrify/issues/7/labels{/name}","comments_url":"https://api.github.com/repos/hellonarrativ/spectrify/issues/7/comments","events_url":"https://api.github.com/repos/hellonarrativ/spectrify/issues/7/events","html_url":"https://github.com/hellonarrativ/spectrify/issues/7","id":262151027,"number":7,"title":"Partitioned Table Support","user":{"login":"andrewgross","id":370118,"avatar_url":"https://avatars1.githubusercontent.com/u/370118?v=4","gravatar_id":"","url":"https://api.github.com/users/andrewgross","html_url":"https://github.com/andrewgross","followers_url":"https://api.github.com/users/andrewgross/followers","following_url":"https://api.github.com/users/andrewgross/following{/other_user}","gists_url":"https://api.github.com/users/andrewgross/gists{/gist_id}","starred_url":"https://api.github.com/users/andrewgross/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andrewgross/subscriptions","organizations_url":"https://api.github.com/users/andrewgross/orgs","repos_url":"https://api.github.com/users/andrewgross/repos","events_url":"https://api.github.com/users/andrewgross/events{/privacy}","received_events_url":"https://api.github.com/users/andrewgross/received_events","type":"User","site_admin":false},"labels":[{"id":693773411,"url":"https://api.github.com/repos/hellonarrativ/spectrify/labels/enhancement","name":"enhancement","color":"84b6eb","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2017-10-02T16:51:41Z","updated_at":"2018-04-10T05:07:33Z","closed_at":null,"author_association":"NONE","body":"Hey,\r\n\r\nAwesome work on this.  I did some similar stuff internally using Spark as the conversion engine instead of PyArrow.  Did you have plans to add partitioning support?  It might be a bit tricky due to data size and needing to inspect/sort the CSV data in Python.\r\n\r\nI did some similar work on a JSON -> Parquet converter that we use with Spectrum\r\n\r\nhttps://github.com/andrewgross/json2parquet\r\n\r\nAnd added support for partitioning, but it relied on inspecting DateTime objects in Python, which was not particularly CPU or memory efficient."},"comment":{"url":"https://api.github.com/repos/hellonarrativ/spectrify/issues/comments/379975273","html_url":"https://github.com/hellonarrativ/spectrify/issues/7#issuecomment-379975273","issue_url":"https://api.github.com/repos/hellonarrativ/spectrify/issues/7","id":379975273,"user":{"login":"naveenarumugam","id":9331763,"avatar_url":"https://avatars1.githubusercontent.com/u/9331763?v=4","gravatar_id":"","url":"https://api.github.com/users/naveenarumugam","html_url":"https://github.com/naveenarumugam","followers_url":"https://api.github.com/users/naveenarumugam/followers","following_url":"https://api.github.com/users/naveenarumugam/following{/other_user}","gists_url":"https://api.github.com/users/naveenarumugam/gists{/gist_id}","starred_url":"https://api.github.com/users/naveenarumugam/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/naveenarumugam/subscriptions","organizations_url":"https://api.github.com/users/naveenarumugam/orgs","repos_url":"https://api.github.com/users/naveenarumugam/repos","events_url":"https://api.github.com/users/naveenarumugam/events{/privacy}","received_events_url":"https://api.github.com/users/naveenarumugam/received_events","type":"User","site_admin":false},"created_at":"2018-04-10T05:07:33Z","updated_at":"2018-04-10T05:07:33Z","author_association":"NONE","body":"Thanks @andrewgross.  I had done something similar. But, this is awesome, will be helpful going forward."}}
{"actor":{"display_login":"naveenarumugam"}}