{"action":"opened","issue":{"url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/291","repository_url":"https://api.github.com/repos/BitFunnel/BitFunnel","labels_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/291/labels{/name}","comments_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/291/comments","events_url":"https://api.github.com/repos/BitFunnel/BitFunnel/issues/291/events","html_url":"https://github.com/BitFunnel/BitFunnel/issues/291","id":187266228,"number":291,"title":"Implement multiple shards","user":{"login":"danluu","id":157136,"avatar_url":"https://avatars.githubusercontent.com/u/157136?v=3","gravatar_id":"","url":"https://api.github.com/users/danluu","html_url":"https://github.com/danluu","followers_url":"https://api.github.com/users/danluu/followers","following_url":"https://api.github.com/users/danluu/following{/other_user}","gists_url":"https://api.github.com/users/danluu/gists{/gist_id}","starred_url":"https://api.github.com/users/danluu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danluu/subscriptions","organizations_url":"https://api.github.com/users/danluu/orgs","repos_url":"https://api.github.com/users/danluu/repos","events_url":"https://api.github.com/users/danluu/events{/privacy}","received_events_url":"https://api.github.com/users/danluu/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-11-04T07:01:36Z","updated_at":"2016-11-04T07:01:36Z","closed_at":null,"body":"See #288, #290, and [this post](http://bitfunnel.org/row-table-analysis/) by @MikeHopcroft for the reasons this is necessary.\r\n\r\nWe currently make a default `ShardDefintion` that gives us one shard. To handle multiple shards, we'll have to do the following:\r\n\r\n* ConfigureFor*` in `Ingestor` could load a `ShardDefinition` from the `FileManager`.\r\n* The `ShardDefinition` stream constructor and write method will need to be ported.\r\n* `FileManager` will need its `ShardDefinition` stuff ported.\r\n* We'll have to make a `ShardDefinition` file.\r\n\r\nAfter doing the port, we'll have to have a step that creates a `ShardDefinition` between running `StatisticsBuilder` and running `TermTableBuilder`.\r\n\r\n"}}
{"actor":{"display_login":"danluu"}}