{"action":"created","issue":{"url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/issues/14","repository_url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift","labels_url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/issues/14/labels{/name}","comments_url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/issues/14/comments","events_url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/issues/14/events","html_url":"https://github.com/kitchensurfing/postgres_to_redshift/pull/14","id":155584967,"number":14,"title":"Fix #13 `write': failed to allocate memory (NoMemoryError)","user":{"login":"ashawley","id":358615,"avatar_url":"https://avatars.githubusercontent.com/u/358615?v=3","gravatar_id":"","url":"https://api.github.com/users/ashawley","html_url":"https://github.com/ashawley","followers_url":"https://api.github.com/users/ashawley/followers","following_url":"https://api.github.com/users/ashawley/following{/other_user}","gists_url":"https://api.github.com/users/ashawley/gists{/gist_id}","starred_url":"https://api.github.com/users/ashawley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ashawley/subscriptions","organizations_url":"https://api.github.com/users/ashawley/orgs","repos_url":"https://api.github.com/users/ashawley/repos","events_url":"https://api.github.com/users/ashawley/events{/privacy}","received_events_url":"https://api.github.com/users/ashawley/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2016-05-18T19:42:00Z","updated_at":"2016-05-19T14:41:34Z","closed_at":"2016-05-18T20:06:09Z","pull_request":{"url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/pulls/14","html_url":"https://github.com/kitchensurfing/postgres_to_redshift/pull/14","diff_url":"https://github.com/kitchensurfing/postgres_to_redshift/pull/14.diff","patch_url":"https://github.com/kitchensurfing/postgres_to_redshift/pull/14.patch"},"body":"Using disk as an intermediary fixes the memory problem, but will affect runtime performance negatively and also means the application is dependent on the local filesystem, now. "},"comment":{"url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/issues/comments/220345295","html_url":"https://github.com/kitchensurfing/postgres_to_redshift/pull/14#issuecomment-220345295","issue_url":"https://api.github.com/repos/kitchensurfing/postgres_to_redshift/issues/14","id":220345295,"user":{"login":"ashawley","id":358615,"avatar_url":"https://avatars.githubusercontent.com/u/358615?v=3","gravatar_id":"","url":"https://api.github.com/users/ashawley","html_url":"https://github.com/ashawley","followers_url":"https://api.github.com/users/ashawley/followers","following_url":"https://api.github.com/users/ashawley/following{/other_user}","gists_url":"https://api.github.com/users/ashawley/gists{/gist_id}","starred_url":"https://api.github.com/users/ashawley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ashawley/subscriptions","organizations_url":"https://api.github.com/users/ashawley/orgs","repos_url":"https://api.github.com/users/ashawley/repos","events_url":"https://api.github.com/users/ashawley/events{/privacy}","received_events_url":"https://api.github.com/users/ashawley/received_events","type":"User","site_admin":false},"created_at":"2016-05-19T14:41:34Z","updated_at":"2016-05-19T14:41:34Z","body":"The large tables are still giving me trouble, so I've only been able to transfer the smaller tables.  The smaller tables are about 1.1GB in total of compressed data (6GB uncompressed).  For both `StringIO` and for `Tempfile`, it is taking the same amount of time: ~35 minutes.  They are being copied from a db.t2.small RDS instance to a dc1.large Redshift cluster using a t2.small EC2 instance to run the gem."}}