{"action":"created","issue":{"url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/issues/20","repository_url":"https://api.github.com/repos/snowplow/snowplow-s3-loader","labels_url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/issues/20/labels{/name}","comments_url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/issues/20/comments","events_url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/issues/20/events","html_url":"https://github.com/snowplow/snowplow-s3-loader/issues/20","id":79368305,"node_id":"MDU6SXNzdWU3OTM2ODMwNQ==","number":20,"title":"Add file name strategies","user":{"login":"alexanderdean","id":200511,"node_id":"MDQ6VXNlcjIwMDUxMQ==","avatar_url":"https://avatars0.githubusercontent.com/u/200511?v=4","gravatar_id":"","url":"https://api.github.com/users/alexanderdean","html_url":"https://github.com/alexanderdean","followers_url":"https://api.github.com/users/alexanderdean/followers","following_url":"https://api.github.com/users/alexanderdean/following{/other_user}","gists_url":"https://api.github.com/users/alexanderdean/gists{/gist_id}","starred_url":"https://api.github.com/users/alexanderdean/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexanderdean/subscriptions","organizations_url":"https://api.github.com/users/alexanderdean/orgs","repos_url":"https://api.github.com/users/alexanderdean/repos","events_url":"https://api.github.com/users/alexanderdean/events{/privacy}","received_events_url":"https://api.github.com/users/alexanderdean/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"BenFradet","id":1737211,"node_id":"MDQ6VXNlcjE3MzcyMTE=","avatar_url":"https://avatars2.githubusercontent.com/u/1737211?v=4","gravatar_id":"","url":"https://api.github.com/users/BenFradet","html_url":"https://github.com/BenFradet","followers_url":"https://api.github.com/users/BenFradet/followers","following_url":"https://api.github.com/users/BenFradet/following{/other_user}","gists_url":"https://api.github.com/users/BenFradet/gists{/gist_id}","starred_url":"https://api.github.com/users/BenFradet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BenFradet/subscriptions","organizations_url":"https://api.github.com/users/BenFradet/orgs","repos_url":"https://api.github.com/users/BenFradet/repos","events_url":"https://api.github.com/users/BenFradet/events{/privacy}","received_events_url":"https://api.github.com/users/BenFradet/received_events","type":"User","site_admin":false},"assignees":[{"login":"BenFradet","id":1737211,"node_id":"MDQ6VXNlcjE3MzcyMTE=","avatar_url":"https://avatars2.githubusercontent.com/u/1737211?v=4","gravatar_id":"","url":"https://api.github.com/users/BenFradet","html_url":"https://github.com/BenFradet","followers_url":"https://api.github.com/users/BenFradet/followers","following_url":"https://api.github.com/users/BenFradet/following{/other_user}","gists_url":"https://api.github.com/users/BenFradet/gists{/gist_id}","starred_url":"https://api.github.com/users/BenFradet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BenFradet/subscriptions","organizations_url":"https://api.github.com/users/BenFradet/orgs","repos_url":"https://api.github.com/users/BenFradet/repos","events_url":"https://api.github.com/users/BenFradet/events{/privacy}","received_events_url":"https://api.github.com/users/BenFradet/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/milestones/10","html_url":"https://github.com/snowplow/snowplow-s3-loader/milestone/10","labels_url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/milestones/10/labels","id":2655687,"node_id":"MDk6TWlsZXN0b25lMjY1NTY4Nw==","number":10,"title":"Version 0.8.0","description":"","creator":{"login":"alexanderdean","id":200511,"node_id":"MDQ6VXNlcjIwMDUxMQ==","avatar_url":"https://avatars0.githubusercontent.com/u/200511?v=4","gravatar_id":"","url":"https://api.github.com/users/alexanderdean","html_url":"https://github.com/alexanderdean","followers_url":"https://api.github.com/users/alexanderdean/followers","following_url":"https://api.github.com/users/alexanderdean/following{/other_user}","gists_url":"https://api.github.com/users/alexanderdean/gists{/gist_id}","starred_url":"https://api.github.com/users/alexanderdean/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexanderdean/subscriptions","organizations_url":"https://api.github.com/users/alexanderdean/orgs","repos_url":"https://api.github.com/users/alexanderdean/repos","events_url":"https://api.github.com/users/alexanderdean/events{/privacy}","received_events_url":"https://api.github.com/users/alexanderdean/received_events","type":"User","site_admin":false},"open_issues":15,"closed_issues":2,"state":"open","created_at":"2017-07-22T09:13:28Z","updated_at":"2018-04-30T10:25:35Z","due_on":null,"closed_at":null},"comments":2,"created_at":"2015-05-22T09:10:28Z","updated_at":"2018-08-09T06:07:06Z","closed_at":null,"author_association":"MEMBER","body":"We should support:\n1. The current file name strategy (we need to come up with a sexy name for this)\n2. A new strategy, see below (we need to come up with a sexy name for this)\n### New strategy\n- On initialization of each sink instance, generate a UUID and create a bigint counter set to 0\n- First file is `<UUID>-000000000000000...0` (where 0s are padded out to max length of a bigint)\n- Second file is `<UUID>-0000000000...1`, i.e. counter is incremented\n- Third file is `<UUID>-0000000000...2`, i.e. counter is incremented\n- On server restart, generate a new UUID and create a bigint counter set to 0\n\nThis is a strategy designed to:\n- Have minimal moving parts\n- Be extremely idiotproof\n- Minimize the size of any manifest which needs to keep track of which files have been processed\n"},"comment":{"url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/issues/comments/411647272","html_url":"https://github.com/snowplow/snowplow-s3-loader/issues/20#issuecomment-411647272","issue_url":"https://api.github.com/repos/snowplow/snowplow-s3-loader/issues/20","id":411647272,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMTY0NzI3Mg==","user":{"login":"sunshineo","id":1072766,"node_id":"MDQ6VXNlcjEwNzI3NjY=","avatar_url":"https://avatars0.githubusercontent.com/u/1072766?v=4","gravatar_id":"","url":"https://api.github.com/users/sunshineo","html_url":"https://github.com/sunshineo","followers_url":"https://api.github.com/users/sunshineo/followers","following_url":"https://api.github.com/users/sunshineo/following{/other_user}","gists_url":"https://api.github.com/users/sunshineo/gists{/gist_id}","starred_url":"https://api.github.com/users/sunshineo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sunshineo/subscriptions","organizations_url":"https://api.github.com/users/sunshineo/orgs","repos_url":"https://api.github.com/users/sunshineo/repos","events_url":"https://api.github.com/users/sunshineo/events{/privacy}","received_events_url":"https://api.github.com/users/sunshineo/received_events","type":"User","site_admin":false},"created_at":"2018-08-09T06:07:06Z","updated_at":"2018-08-09T06:07:06Z","author_association":"NONE","body":"Before this get implemented, anyone have any tools that can go through current files and move then to a folder structure like the one proposed here?"}}
{"actor":{"display_login":"sunshineo"}}