{"action":"closed","issue":{"url":"https://api.github.com/repos/graknlabs/grakn/issues/3538","repository_url":"https://api.github.com/repos/graknlabs/grakn","labels_url":"https://api.github.com/repos/graknlabs/grakn/issues/3538/labels{/name}","comments_url":"https://api.github.com/repos/graknlabs/grakn/issues/3538/comments","events_url":"https://api.github.com/repos/graknlabs/grakn/issues/3538/events","html_url":"https://github.com/graknlabs/grakn/issues/3538","id":362785377,"node_id":"MDU6SXNzdWUzNjI3ODUzNzc=","number":3538,"title":"Improve node sharding in order to tackle the fragmentation problem","user":{"login":"grakn-bot","id":42977137,"node_id":"MDQ6VXNlcjQyOTc3MTM3","avatar_url":"https://avatars2.githubusercontent.com/u/42977137?v=4","gravatar_id":"","url":"https://api.github.com/users/grakn-bot","html_url":"https://github.com/grakn-bot","followers_url":"https://api.github.com/users/grakn-bot/followers","following_url":"https://api.github.com/users/grakn-bot/following{/other_user}","gists_url":"https://api.github.com/users/grakn-bot/gists{/gist_id}","starred_url":"https://api.github.com/users/grakn-bot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/grakn-bot/subscriptions","organizations_url":"https://api.github.com/users/grakn-bot/orgs","repos_url":"https://api.github.com/users/grakn-bot/repos","events_url":"https://api.github.com/users/grakn-bot/events{/privacy}","received_events_url":"https://api.github.com/users/grakn-bot/received_events","type":"User","site_admin":false},"labels":[{"id":406573491,"node_id":"MDU6TGFiZWw0MDY1NzM0OTE=","url":"https://api.github.com/repos/graknlabs/grakn/labels/feature","name":"feature","color":"41DFFF","default":false},{"id":1064949303,"node_id":"MDU6TGFiZWwxMDY0OTQ5MzAz","url":"https://api.github.com/repos/graknlabs/grakn/labels/grakn%20core","name":"grakn core","color":"ededed","default":false}],"state":"closed","locked":false,"assignee":{"login":"lolski","id":464164,"node_id":"MDQ6VXNlcjQ2NDE2NA==","avatar_url":"https://avatars0.githubusercontent.com/u/464164?v=4","gravatar_id":"","url":"https://api.github.com/users/lolski","html_url":"https://github.com/lolski","followers_url":"https://api.github.com/users/lolski/followers","following_url":"https://api.github.com/users/lolski/following{/other_user}","gists_url":"https://api.github.com/users/lolski/gists{/gist_id}","starred_url":"https://api.github.com/users/lolski/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lolski/subscriptions","organizations_url":"https://api.github.com/users/lolski/orgs","repos_url":"https://api.github.com/users/lolski/repos","events_url":"https://api.github.com/users/lolski/events{/privacy}","received_events_url":"https://api.github.com/users/lolski/received_events","type":"User","site_admin":false},"assignees":[{"login":"lolski","id":464164,"node_id":"MDQ6VXNlcjQ2NDE2NA==","avatar_url":"https://avatars0.githubusercontent.com/u/464164?v=4","gravatar_id":"","url":"https://api.github.com/users/lolski","html_url":"https://github.com/lolski","followers_url":"https://api.github.com/users/lolski/followers","following_url":"https://api.github.com/users/lolski/following{/other_user}","gists_url":"https://api.github.com/users/lolski/gists{/gist_id}","starred_url":"https://api.github.com/users/lolski/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lolski/subscriptions","organizations_url":"https://api.github.com/users/lolski/orgs","repos_url":"https://api.github.com/users/lolski/repos","events_url":"https://api.github.com/users/lolski/events{/privacy}","received_events_url":"https://api.github.com/users/lolski/received_events","type":"User","site_admin":false}],"milestone":null,"comments":1,"created_at":"2018-09-21T21:49:44Z","updated_at":"2018-09-22T17:28:07Z","closed_at":"2018-09-22T17:28:07Z","author_association":"MEMBER","body":"_This issue was originally posted by @lolski  on 2018-02-08 19:22_.\n\nGoal\nLet's say the new shard creation threshold is set to 10000.\nWhen the total entity being held by the shard 1 reaches 10000, Grakn will proceed to create a new shard, shard 2. When receiving new entities, they will be held by shard 2.\nThe problem arises when we delete entities on the old shard. Let's say we delete all entities held by shard 1. Even though now shard 1 is completely empty, by the current algorithm Grakn will still hold new entities in shard 2.\nIn practice, this will lead to a \"fragmentation problem\" where we have many empty shards or shards with very few nodes.\n"}}
{"actor":{"display_login":"grakn-bot"}}