{"action":"created","comment":{"url":"https://api.github.com/repos/crate/crate-web/pulls/comments/57874598","id":57874598,"diff_hunk":"@@ -0,0 +1,239 @@\n+title: Crate guest post for Azure - Setting up Azure for Crate\n+author: Chris Ward\n+description: Setting up a 1001 node Crate cluster on Azure with Docker Swarm\n+created: 2016-03-29\n+status: publish\n+post_type: post\n+tags: azure, arm\n+category: developernews\n+\n+# Crate guest post for Azure - Setting up Azure for Crate\n+\n+[Crate.io](https://crate.io/) is striving to create the most scalable database in our industry;\n+we aim to make scaling your data from millions to billions of records and beyond, as simple as\n+possible.\n+\n+We have clients who write and query gigabytes of data a minute, store terabytes a day and love the\n+performance and stability that Crate offers. But the question always remained at the back of our\n+minds: when taken to the extreme, what is Crate really capable of?\n+\n+We specifically wanted to:\n+\n+- Know how Crate would distribute shards and partitions across such a large cluster.\n+- Examine the overhead added by the cluster management.\n+- See at what speeds the cluster could write data.\n+\n+Microsoft Azure generously lent us the use of 8000 cores as the infrastructure for this test and\n+engineer time to guide us through problems and questions we might have.\n+\n+Microsoft wanted to show that their Azure platform was reliable and capable enough for a project\n+that would scale rapidly and so resource intensive.\n+\n+\n+## Plan\n+\n+While discussing the approach of setting up a 1001 node Crate cluster, we immediately thought about\n+using [Docker Swarm](https://www.docker.com/products/docker-swarm) to launch Crate. However, we\n+also wanted to see how the conventional deployment, using regular packages, would work out.\n+\n+### Docker Swarm setup\n+\n+Our initial approach was to start the Crate cluster in containerized environment using","path":"pages/a/1k1-azure-post.html","position":41,"original_position":41,"commit_id":"e8f749253e42c565c2182f7e33083870c2338f6a","original_commit_id":"e8f749253e42c565c2182f7e33083870c2338f6a","user":{"login":"chaudum","id":281260,"avatar_url":"https://avatars.githubusercontent.com/u/281260?v=3","gravatar_id":"","url":"https://api.github.com/users/chaudum","html_url":"https://github.com/chaudum","followers_url":"https://api.github.com/users/chaudum/followers","following_url":"https://api.github.com/users/chaudum/following{/other_user}","gists_url":"https://api.github.com/users/chaudum/gists{/gist_id}","starred_url":"https://api.github.com/users/chaudum/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chaudum/subscriptions","organizations_url":"https://api.github.com/users/chaudum/orgs","repos_url":"https://api.github.com/users/chaudum/repos","events_url":"https://api.github.com/users/chaudum/events{/privacy}","received_events_url":"https://api.github.com/users/chaudum/received_events","type":"User","site_admin":false},"body":"in *a* containerized","created_at":"2016-03-30T11:42:49Z","updated_at":"2016-03-30T11:42:49Z","html_url":"https://github.com/crate/crate-web/pull/359#discussion_r57874598","pull_request_url":"https://api.github.com/repos/crate/crate-web/pulls/359","_links":{"self":{"href":"https://api.github.com/repos/crate/crate-web/pulls/comments/57874598"},"html":{"href":"https://github.com/crate/crate-web/pull/359#discussion_r57874598"},"pull_request":{"href":"https://api.github.com/repos/crate/crate-web/pulls/359"}}},"pull_request":{"url":"https://api.github.com/repos/crate/crate-web/pulls/359","id":64489688,"html_url":"https://github.com/crate/crate-web/pull/359","diff_url":"https://github.com/crate/crate-web/pull/359.diff","patch_url":"https://github.com/crate/crate-web/pull/359.patch","issue_url":"https://api.github.com/repos/crate/crate-web/issues/359","number":359,"state":"open","locked":false,"title":"azure 1k1 blog post","user":{"login":"kovrus","id":7442373,"avatar_url":"https://avatars.githubusercontent.com/u/7442373?v=3","gravatar_id":"","url":"https://api.github.com/users/kovrus","html_url":"https://github.com/kovrus","followers_url":"https://api.github.com/users/kovrus/followers","following_url":"https://api.github.com/users/kovrus/following{/other_user}","gists_url":"https://api.github.com/users/kovrus/gists{/gist_id}","starred_url":"https://api.github.com/users/kovrus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kovrus/subscriptions","organizations_url":"https://api.github.com/users/kovrus/orgs","repos_url":"https://api.github.com/users/kovrus/repos","events_url":"https://api.github.com/users/kovrus/events{/privacy}","received_events_url":"https://api.github.com/users/kovrus/received_events","type":"User","site_admin":false},"body":"","created_at":"2016-03-29T16:00:33Z","updated_at":"2016-03-30T11:42:49Z","closed_at":null,"merged_at":null,"merge_commit_sha":"e2c074501ba22b998d6853fcf1e8c14311b30c83","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/crate/crate-web/pulls/359/commits","review_comments_url":"https://api.github.com/repos/crate/crate-web/pulls/359/comments","review_comment_url":"https://api.github.com/repos/crate/crate-web/pulls/comments{/number}","comments_url":"https://api.github.com/repos/crate/crate-web/issues/359/comments","statuses_url":"https://api.github.com/repos/crate/crate-web/statuses/e8f749253e42c565c2182f7e33083870c2338f6a","head":{"label":"crate:azure_blog_post","ref":"azure_blog_post","sha":"e8f749253e42c565c2182f7e33083870c2338f6a","user":{"login":"crate","id":4048232,"avatar_url":"https://avatars.githubusercontent.com/u/4048232?v=3","gravatar_id":"","url":"https://api.github.com/users/crate","html_url":"https://github.com/crate","followers_url":"https://api.github.com/users/crate/followers","following_url":"https://api.github.com/users/crate/following{/other_user}","gists_url":"https://api.github.com/users/crate/gists{/gist_id}","starred_url":"https://api.github.com/users/crate/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/crate/subscriptions","organizations_url":"https://api.github.com/users/crate/orgs","repos_url":"https://api.github.com/users/crate/repos","events_url":"https://api.github.com/users/crate/events{/privacy}","received_events_url":"https://api.github.com/users/crate/received_events","type":"Organization","site_admin":false},"repo":{"id":28360868,"name":"crate-web","full_name":"crate/crate-web","owner":{"login":"crate","id":4048232,"avatar_url":"https://avatars.githubusercontent.com/u/4048232?v=3","gravatar_id":"","url":"https://api.github.com/users/crate","html_url":"https://github.com/crate","followers_url":"https://api.github.com/users/crate/followers","following_url":"https://api.github.com/users/crate/following{/other_user}","gists_url":"https://api.github.com/users/crate/gists{/gist_id}","starred_url":"https://api.github.com/users/crate/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/crate/subscriptions","organizations_url":"https://api.github.com/users/crate/orgs","repos_url":"https://api.github.com/users/crate/repos","events_url":"https://api.github.com/users/crate/events{/privacy}","received_events_url":"https://api.github.com/users/crate/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/crate/crate-web","description":"Crate.IO Website","fork":false,"url":"https://api.github.com/repos/crate/crate-web","forks_url":"https://api.github.com/repos/crate/crate-web/forks","keys_url":"https://api.github.com/repos/crate/crate-web/keys{/key_id}","collaborators_url":"https://api.github.com/repos/crate/crate-web/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/crate/crate-web/teams","hooks_url":"https://api.github.com/repos/crate/crate-web/hooks","issue_events_url":"https://api.github.com/repos/crate/crate-web/issues/events{/number}","events_url":"https://api.github.com/repos/crate/crate-web/events","assignees_url":"https://api.github.com/repos/crate/crate-web/assignees{/user}","branches_url":"https://api.github.com/repos/crate/crate-web/branches{/branch}","tags_url":"https://api.github.com/repos/crate/crate-web/tags","blobs_url":"https://api.github.com/repos/crate/crate-web/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/crate/crate-web/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/crate/crate-web/git/refs{/sha}","trees_url":"https://api.github.com/repos/crate/crate-web/git/trees{/sha}","statuses_url":"https://api.github.com/repos/crate/crate-web/statuses/{sha}","languages_url":"https://api.github.com/repos/crate/crate-web/languages","stargazers_url":"https://api.github.com/repos/crate/crate-web/stargazers","contributors_url":"https://api.github.com/repos/crate/crate-web/contributors","subscribers_url":"https://api.github.com/repos/crate/crate-web/subscribers","subscription_url":"https://api.github.com/repos/crate/crate-web/subscription","commits_url":"https://api.github.com/repos/crate/crate-web/commits{/sha}","git_commits_url":"https://api.github.com/repos/crate/crate-web/git/commits{/sha}","comments_url":"https://api.github.com/repos/crate/crate-web/comments{/number}","issue_comment_url":"https://api.github.com/repos/crate/crate-web/issues/comments{/number}","contents_url":"https://api.github.com/repos/crate/crate-web/contents/{+path}","compare_url":"https://api.github.com/repos/crate/crate-web/compare/{base}...{head}","merges_url":"https://api.github.com/repos/crate/crate-web/merges","archive_url":"https://api.github.com/repos/crate/crate-web/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/crate/crate-web/downloads","issues_url":"https://api.github.com/repos/crate/crate-web/issues{/number}","pulls_url":"https://api.github.com/repos/crate/crate-web/pulls{/number}","milestones_url":"https://api.github.com/repos/crate/crate-web/milestones{/number}","notifications_url":"https://api.github.com/repos/crate/crate-web/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/crate/crate-web/labels{/name}","releases_url":"https://api.github.com/repos/crate/crate-web/releases{/id}","deployments_url":"https://api.github.com/repos/crate/crate-web/deployments","created_at":"2014-12-22T21:44:18Z","updated_at":"2016-03-17T03:03:03Z","pushed_at":"2016-03-30T07:54:16Z","git_url":"git://github.com/crate/crate-web.git","ssh_url":"git@github.com:crate/crate-web.git","clone_url":"https://github.com/crate/crate-web.git","svn_url":"https://github.com/crate/crate-web","homepage":null,"size":22502,"stargazers_count":12,"watchers_count":12,"language":"HTML","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":8,"mirror_url":null,"open_issues_count":5,"forks":8,"open_issues":5,"watchers":12,"default_branch":"master"}},"base":{"label":"crate:master","ref":"master","sha":"6d62cddde6b08bcab9f95f9053760741ed9d9cc0","user":{"login":"crate","id":4048232,"avatar_url":"https://avatars.githubusercontent.com/u/4048232?v=3","gravatar_id":"","url":"https://api.github.com/users/crate","html_url":"https://github.com/crate","followers_url":"https://api.github.com/users/crate/followers","following_url":"https://api.github.com/users/crate/following{/other_user}","gists_url":"https://api.github.com/users/crate/gists{/gist_id}","starred_url":"https://api.github.com/users/crate/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/crate/subscriptions","organizations_url":"https://api.github.com/users/crate/orgs","repos_url":"https://api.github.com/users/crate/repos","events_url":"https://api.github.com/users/crate/events{/privacy}","received_events_url":"https://api.github.com/users/crate/received_events","type":"Organization","site_admin":false},"repo":{"id":28360868,"name":"crate-web","full_name":"crate/crate-web","owner":{"login":"crate","id":4048232,"avatar_url":"https://avatars.githubusercontent.com/u/4048232?v=3","gravatar_id":"","url":"https://api.github.com/users/crate","html_url":"https://github.com/crate","followers_url":"https://api.github.com/users/crate/followers","following_url":"https://api.github.com/users/crate/following{/other_user}","gists_url":"https://api.github.com/users/crate/gists{/gist_id}","starred_url":"https://api.github.com/users/crate/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/crate/subscriptions","organizations_url":"https://api.github.com/users/crate/orgs","repos_url":"https://api.github.com/users/crate/repos","events_url":"https://api.github.com/users/crate/events{/privacy}","received_events_url":"https://api.github.com/users/crate/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/crate/crate-web","description":"Crate.IO Website","fork":false,"url":"https://api.github.com/repos/crate/crate-web","forks_url":"https://api.github.com/repos/crate/crate-web/forks","keys_url":"https://api.github.com/repos/crate/crate-web/keys{/key_id}","collaborators_url":"https://api.github.com/repos/crate/crate-web/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/crate/crate-web/teams","hooks_url":"https://api.github.com/repos/crate/crate-web/hooks","issue_events_url":"https://api.github.com/repos/crate/crate-web/issues/events{/number}","events_url":"https://api.github.com/repos/crate/crate-web/events","assignees_url":"https://api.github.com/repos/crate/crate-web/assignees{/user}","branches_url":"https://api.github.com/repos/crate/crate-web/branches{/branch}","tags_url":"https://api.github.com/repos/crate/crate-web/tags","blobs_url":"https://api.github.com/repos/crate/crate-web/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/crate/crate-web/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/crate/crate-web/git/refs{/sha}","trees_url":"https://api.github.com/repos/crate/crate-web/git/trees{/sha}","statuses_url":"https://api.github.com/repos/crate/crate-web/statuses/{sha}","languages_url":"https://api.github.com/repos/crate/crate-web/languages","stargazers_url":"https://api.github.com/repos/crate/crate-web/stargazers","contributors_url":"https://api.github.com/repos/crate/crate-web/contributors","subscribers_url":"https://api.github.com/repos/crate/crate-web/subscribers","subscription_url":"https://api.github.com/repos/crate/crate-web/subscription","commits_url":"https://api.github.com/repos/crate/crate-web/commits{/sha}","git_commits_url":"https://api.github.com/repos/crate/crate-web/git/commits{/sha}","comments_url":"https://api.github.com/repos/crate/crate-web/comments{/number}","issue_comment_url":"https://api.github.com/repos/crate/crate-web/issues/comments{/number}","contents_url":"https://api.github.com/repos/crate/crate-web/contents/{+path}","compare_url":"https://api.github.com/repos/crate/crate-web/compare/{base}...{head}","merges_url":"https://api.github.com/repos/crate/crate-web/merges","archive_url":"https://api.github.com/repos/crate/crate-web/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/crate/crate-web/downloads","issues_url":"https://api.github.com/repos/crate/crate-web/issues{/number}","pulls_url":"https://api.github.com/repos/crate/crate-web/pulls{/number}","milestones_url":"https://api.github.com/repos/crate/crate-web/milestones{/number}","notifications_url":"https://api.github.com/repos/crate/crate-web/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/crate/crate-web/labels{/name}","releases_url":"https://api.github.com/repos/crate/crate-web/releases{/id}","deployments_url":"https://api.github.com/repos/crate/crate-web/deployments","created_at":"2014-12-22T21:44:18Z","updated_at":"2016-03-17T03:03:03Z","pushed_at":"2016-03-30T07:54:16Z","git_url":"git://github.com/crate/crate-web.git","ssh_url":"git@github.com:crate/crate-web.git","clone_url":"https://github.com/crate/crate-web.git","svn_url":"https://github.com/crate/crate-web","homepage":null,"size":22502,"stargazers_count":12,"watchers_count":12,"language":"HTML","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":8,"mirror_url":null,"open_issues_count":5,"forks":8,"open_issues":5,"watchers":12,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/crate/crate-web/pulls/359"},"html":{"href":"https://github.com/crate/crate-web/pull/359"},"issue":{"href":"https://api.github.com/repos/crate/crate-web/issues/359"},"comments":{"href":"https://api.github.com/repos/crate/crate-web/issues/359/comments"},"review_comments":{"href":"https://api.github.com/repos/crate/crate-web/pulls/359/comments"},"review_comment":{"href":"https://api.github.com/repos/crate/crate-web/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/crate/crate-web/pulls/359/commits"},"statuses":{"href":"https://api.github.com/repos/crate/crate-web/statuses/e8f749253e42c565c2182f7e33083870c2338f6a"}}}}