{"action":"created","comment":{"url":"https://api.github.com/repos/Automattic/wp-calypso/pulls/comments/51733193","id":51733193,"diff_hunk":"@@ -101,5 +101,14 @@ module.exports = {\n \t\t\tdescription: 50\n \t\t},\n \t\tdefaultVariation: 'description'\n-\t}\n+\t},\n+\theadstart: {\n+\t\tdatestamp: '20160203',\n+\t\tvariations: {\n+\t\t\toriginal: 20,","path":"client/lib/abtest/active-tests.js","position":18,"original_position":18,"commit_id":"8bb50797df3a4f52f3ac38f7cad1c7add6aaa741","original_commit_id":"8bb50797df3a4f52f3ac38f7cad1c7add6aaa741","user":{"login":"kwight","id":349751,"avatar_url":"https://avatars.githubusercontent.com/u/349751?v=3","gravatar_id":"","url":"https://api.github.com/users/kwight","html_url":"https://github.com/kwight","followers_url":"https://api.github.com/users/kwight/followers","following_url":"https://api.github.com/users/kwight/following{/other_user}","gists_url":"https://api.github.com/users/kwight/gists{/gist_id}","starred_url":"https://api.github.com/users/kwight/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kwight/subscriptions","organizations_url":"https://api.github.com/users/kwight/orgs","repos_url":"https://api.github.com/users/kwight/repos","events_url":"https://api.github.com/users/kwight/events{/privacy}","received_events_url":"https://api.github.com/users/kwight/received_events","type":"User","site_admin":false},"body":"This seems like a lot of users to send through the test; can we do this instead?\r\n\r\n```\r\nheadstart: {\r\n\tdatestamp: '20160203',\r\n\tvariations: {\r\n\t\tmain: 20,\r\n\t\theadstart: 20,\r\n\t\tnotTested: 60\r\n\t},\r\n\tdefaultVariation: 'main'\r\n},\r\n```","created_at":"2016-02-03T15:14:22Z","updated_at":"2016-02-03T15:14:22Z","html_url":"https://github.com/Automattic/wp-calypso/pull/3002#discussion_r51733193","pull_request_url":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002","_links":{"self":{"href":"https://api.github.com/repos/Automattic/wp-calypso/pulls/comments/51733193"},"html":{"href":"https://github.com/Automattic/wp-calypso/pull/3002#discussion_r51733193"},"pull_request":{"href":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002"}}},"pull_request":{"url":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002","id":58042157,"html_url":"https://github.com/Automattic/wp-calypso/pull/3002","diff_url":"https://github.com/Automattic/wp-calypso/pull/3002.diff","patch_url":"https://github.com/Automattic/wp-calypso/pull/3002.patch","issue_url":"https://api.github.com/repos/Automattic/wp-calypso/issues/3002","number":3002,"state":"open","locked":false,"title":"Signup: Add headstart test to default signup flow","user":{"login":"sirbrillig","id":2036909,"avatar_url":"https://avatars.githubusercontent.com/u/2036909?v=3","gravatar_id":"","url":"https://api.github.com/users/sirbrillig","html_url":"https://github.com/sirbrillig","followers_url":"https://api.github.com/users/sirbrillig/followers","following_url":"https://api.github.com/users/sirbrillig/following{/other_user}","gists_url":"https://api.github.com/users/sirbrillig/gists{/gist_id}","starred_url":"https://api.github.com/users/sirbrillig/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sirbrillig/subscriptions","organizations_url":"https://api.github.com/users/sirbrillig/orgs","repos_url":"https://api.github.com/users/sirbrillig/repos","events_url":"https://api.github.com/users/sirbrillig/events{/privacy}","received_events_url":"https://api.github.com/users/sirbrillig/received_events","type":"User","site_admin":false},"body":"Headstart is a tool to automatically populate a new site with default content and settings to better match the demo site for its theme.\r\n\r\nThis PR sends a percentage of users visiting the default signup flow through an identical flow that uses Headstart on the server to pre-populate the new site.\r\n\r\nFollow-up to #2925 which enabled the flow.\r\n\r\n## Testing\r\n\r\n1. Using a logged-out browser (eg: Chrome incognito), visit http://calypso.localhost:3000/start\r\n2. As you are assigned to a flow, your URL will be changed to include the name of the first step in the flow. If you are assigned to the `headstart` flow, the URL will become http://calypso.localhost:3000/start/themes-headstart If instead you see http://calypso.localhost:3000/start/themes, try closing the window and starting again at step 1.\r\n3. If you are assigned to the `headstart` flow, complete the flow to create a new site.\r\n4. Verify that the new site has a lot of pre-populated content (posts, menus, widgets).\r\n\r\nFor example, here is the Boardwalk theme without Headstart:\r\n\r\n<img width=\"959\" alt=\"screen shot 2016-01-29 at 7 28 00 pm\" src=\"https://cloud.githubusercontent.com/assets/2036909/12691907/7d0cb1c6-c6be-11e5-8d03-5188f590ef89.png\">\r\n\r\n...and with Headstart:\r\n\r\n<img width=\"967\" alt=\"screen shot 2016-01-29 at 7 28 13 pm\" src=\"https://cloud.githubusercontent.com/assets/2036909/12691910/84068b00-c6be-11e5-85b5-390d6b104af5.png\">\r\n","created_at":"2016-02-02T20:05:47Z","updated_at":"2016-02-03T15:14:22Z","closed_at":null,"merged_at":null,"merge_commit_sha":"ee6219313ea2e5a361596e19265e6ad47fa97f94","assignee":{"login":"sirbrillig","id":2036909,"avatar_url":"https://avatars.githubusercontent.com/u/2036909?v=3","gravatar_id":"","url":"https://api.github.com/users/sirbrillig","html_url":"https://github.com/sirbrillig","followers_url":"https://api.github.com/users/sirbrillig/followers","following_url":"https://api.github.com/users/sirbrillig/following{/other_user}","gists_url":"https://api.github.com/users/sirbrillig/gists{/gist_id}","starred_url":"https://api.github.com/users/sirbrillig/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sirbrillig/subscriptions","organizations_url":"https://api.github.com/users/sirbrillig/orgs","repos_url":"https://api.github.com/users/sirbrillig/repos","events_url":"https://api.github.com/users/sirbrillig/events{/privacy}","received_events_url":"https://api.github.com/users/sirbrillig/received_events","type":"User","site_admin":false},"milestone":null,"commits_url":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002/commits","review_comments_url":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002/comments","review_comment_url":"https://api.github.com/repos/Automattic/wp-calypso/pulls/comments{/number}","comments_url":"https://api.github.com/repos/Automattic/wp-calypso/issues/3002/comments","statuses_url":"https://api.github.com/repos/Automattic/wp-calypso/statuses/8bb50797df3a4f52f3ac38f7cad1c7add6aaa741","head":{"label":"Automattic:add/headstart-v2-test","ref":"add/headstart-v2-test","sha":"8bb50797df3a4f52f3ac38f7cad1c7add6aaa741","user":{"login":"Automattic","id":887802,"avatar_url":"https://avatars.githubusercontent.com/u/887802?v=3","gravatar_id":"","url":"https://api.github.com/users/Automattic","html_url":"https://github.com/Automattic","followers_url":"https://api.github.com/users/Automattic/followers","following_url":"https://api.github.com/users/Automattic/following{/other_user}","gists_url":"https://api.github.com/users/Automattic/gists{/gist_id}","starred_url":"https://api.github.com/users/Automattic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Automattic/subscriptions","organizations_url":"https://api.github.com/users/Automattic/orgs","repos_url":"https://api.github.com/users/Automattic/repos","events_url":"https://api.github.com/users/Automattic/events{/privacy}","received_events_url":"https://api.github.com/users/Automattic/received_events","type":"Organization","site_admin":false},"repo":{"id":45936895,"name":"wp-calypso","full_name":"Automattic/wp-calypso","owner":{"login":"Automattic","id":887802,"avatar_url":"https://avatars.githubusercontent.com/u/887802?v=3","gravatar_id":"","url":"https://api.github.com/users/Automattic","html_url":"https://github.com/Automattic","followers_url":"https://api.github.com/users/Automattic/followers","following_url":"https://api.github.com/users/Automattic/following{/other_user}","gists_url":"https://api.github.com/users/Automattic/gists{/gist_id}","starred_url":"https://api.github.com/users/Automattic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Automattic/subscriptions","organizations_url":"https://api.github.com/users/Automattic/orgs","repos_url":"https://api.github.com/users/Automattic/repos","events_url":"https://api.github.com/users/Automattic/events{/privacy}","received_events_url":"https://api.github.com/users/Automattic/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Automattic/wp-calypso","description":"The new JavaScript- and API-powered WordPress.com","fork":false,"url":"https://api.github.com/repos/Automattic/wp-calypso","forks_url":"https://api.github.com/repos/Automattic/wp-calypso/forks","keys_url":"https://api.github.com/repos/Automattic/wp-calypso/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Automattic/wp-calypso/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Automattic/wp-calypso/teams","hooks_url":"https://api.github.com/repos/Automattic/wp-calypso/hooks","issue_events_url":"https://api.github.com/repos/Automattic/wp-calypso/issues/events{/number}","events_url":"https://api.github.com/repos/Automattic/wp-calypso/events","assignees_url":"https://api.github.com/repos/Automattic/wp-calypso/assignees{/user}","branches_url":"https://api.github.com/repos/Automattic/wp-calypso/branches{/branch}","tags_url":"https://api.github.com/repos/Automattic/wp-calypso/tags","blobs_url":"https://api.github.com/repos/Automattic/wp-calypso/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Automattic/wp-calypso/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Automattic/wp-calypso/git/refs{/sha}","trees_url":"https://api.github.com/repos/Automattic/wp-calypso/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Automattic/wp-calypso/statuses/{sha}","languages_url":"https://api.github.com/repos/Automattic/wp-calypso/languages","stargazers_url":"https://api.github.com/repos/Automattic/wp-calypso/stargazers","contributors_url":"https://api.github.com/repos/Automattic/wp-calypso/contributors","subscribers_url":"https://api.github.com/repos/Automattic/wp-calypso/subscribers","subscription_url":"https://api.github.com/repos/Automattic/wp-calypso/subscription","commits_url":"https://api.github.com/repos/Automattic/wp-calypso/commits{/sha}","git_commits_url":"https://api.github.com/repos/Automattic/wp-calypso/git/commits{/sha}","comments_url":"https://api.github.com/repos/Automattic/wp-calypso/comments{/number}","issue_comment_url":"https://api.github.com/repos/Automattic/wp-calypso/issues/comments{/number}","contents_url":"https://api.github.com/repos/Automattic/wp-calypso/contents/{+path}","compare_url":"https://api.github.com/repos/Automattic/wp-calypso/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Automattic/wp-calypso/merges","archive_url":"https://api.github.com/repos/Automattic/wp-calypso/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Automattic/wp-calypso/downloads","issues_url":"https://api.github.com/repos/Automattic/wp-calypso/issues{/number}","pulls_url":"https://api.github.com/repos/Automattic/wp-calypso/pulls{/number}","milestones_url":"https://api.github.com/repos/Automattic/wp-calypso/milestones{/number}","notifications_url":"https://api.github.com/repos/Automattic/wp-calypso/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Automattic/wp-calypso/labels{/name}","releases_url":"https://api.github.com/repos/Automattic/wp-calypso/releases{/id}","deployments_url":"https://api.github.com/repos/Automattic/wp-calypso/deployments","created_at":"2015-11-10T20:00:16Z","updated_at":"2016-02-03T13:07:05Z","pushed_at":"2016-02-03T15:08:44Z","git_url":"git://github.com/Automattic/wp-calypso.git","ssh_url":"git@github.com:Automattic/wp-calypso.git","clone_url":"https://github.com/Automattic/wp-calypso.git","svn_url":"https://github.com/Automattic/wp-calypso","homepage":"https://developer.wordpress.com/calypso/","size":53937,"stargazers_count":6735,"watchers_count":6735,"language":"JavaScript","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":759,"mirror_url":null,"open_issues_count":1209,"forks":759,"open_issues":1209,"watchers":6735,"default_branch":"master"}},"base":{"label":"Automattic:master","ref":"master","sha":"f675011748af82e019b0680d40022cd86844b542","user":{"login":"Automattic","id":887802,"avatar_url":"https://avatars.githubusercontent.com/u/887802?v=3","gravatar_id":"","url":"https://api.github.com/users/Automattic","html_url":"https://github.com/Automattic","followers_url":"https://api.github.com/users/Automattic/followers","following_url":"https://api.github.com/users/Automattic/following{/other_user}","gists_url":"https://api.github.com/users/Automattic/gists{/gist_id}","starred_url":"https://api.github.com/users/Automattic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Automattic/subscriptions","organizations_url":"https://api.github.com/users/Automattic/orgs","repos_url":"https://api.github.com/users/Automattic/repos","events_url":"https://api.github.com/users/Automattic/events{/privacy}","received_events_url":"https://api.github.com/users/Automattic/received_events","type":"Organization","site_admin":false},"repo":{"id":45936895,"name":"wp-calypso","full_name":"Automattic/wp-calypso","owner":{"login":"Automattic","id":887802,"avatar_url":"https://avatars.githubusercontent.com/u/887802?v=3","gravatar_id":"","url":"https://api.github.com/users/Automattic","html_url":"https://github.com/Automattic","followers_url":"https://api.github.com/users/Automattic/followers","following_url":"https://api.github.com/users/Automattic/following{/other_user}","gists_url":"https://api.github.com/users/Automattic/gists{/gist_id}","starred_url":"https://api.github.com/users/Automattic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Automattic/subscriptions","organizations_url":"https://api.github.com/users/Automattic/orgs","repos_url":"https://api.github.com/users/Automattic/repos","events_url":"https://api.github.com/users/Automattic/events{/privacy}","received_events_url":"https://api.github.com/users/Automattic/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Automattic/wp-calypso","description":"The new JavaScript- and API-powered WordPress.com","fork":false,"url":"https://api.github.com/repos/Automattic/wp-calypso","forks_url":"https://api.github.com/repos/Automattic/wp-calypso/forks","keys_url":"https://api.github.com/repos/Automattic/wp-calypso/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Automattic/wp-calypso/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Automattic/wp-calypso/teams","hooks_url":"https://api.github.com/repos/Automattic/wp-calypso/hooks","issue_events_url":"https://api.github.com/repos/Automattic/wp-calypso/issues/events{/number}","events_url":"https://api.github.com/repos/Automattic/wp-calypso/events","assignees_url":"https://api.github.com/repos/Automattic/wp-calypso/assignees{/user}","branches_url":"https://api.github.com/repos/Automattic/wp-calypso/branches{/branch}","tags_url":"https://api.github.com/repos/Automattic/wp-calypso/tags","blobs_url":"https://api.github.com/repos/Automattic/wp-calypso/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Automattic/wp-calypso/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Automattic/wp-calypso/git/refs{/sha}","trees_url":"https://api.github.com/repos/Automattic/wp-calypso/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Automattic/wp-calypso/statuses/{sha}","languages_url":"https://api.github.com/repos/Automattic/wp-calypso/languages","stargazers_url":"https://api.github.com/repos/Automattic/wp-calypso/stargazers","contributors_url":"https://api.github.com/repos/Automattic/wp-calypso/contributors","subscribers_url":"https://api.github.com/repos/Automattic/wp-calypso/subscribers","subscription_url":"https://api.github.com/repos/Automattic/wp-calypso/subscription","commits_url":"https://api.github.com/repos/Automattic/wp-calypso/commits{/sha}","git_commits_url":"https://api.github.com/repos/Automattic/wp-calypso/git/commits{/sha}","comments_url":"https://api.github.com/repos/Automattic/wp-calypso/comments{/number}","issue_comment_url":"https://api.github.com/repos/Automattic/wp-calypso/issues/comments{/number}","contents_url":"https://api.github.com/repos/Automattic/wp-calypso/contents/{+path}","compare_url":"https://api.github.com/repos/Automattic/wp-calypso/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Automattic/wp-calypso/merges","archive_url":"https://api.github.com/repos/Automattic/wp-calypso/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Automattic/wp-calypso/downloads","issues_url":"https://api.github.com/repos/Automattic/wp-calypso/issues{/number}","pulls_url":"https://api.github.com/repos/Automattic/wp-calypso/pulls{/number}","milestones_url":"https://api.github.com/repos/Automattic/wp-calypso/milestones{/number}","notifications_url":"https://api.github.com/repos/Automattic/wp-calypso/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Automattic/wp-calypso/labels{/name}","releases_url":"https://api.github.com/repos/Automattic/wp-calypso/releases{/id}","deployments_url":"https://api.github.com/repos/Automattic/wp-calypso/deployments","created_at":"2015-11-10T20:00:16Z","updated_at":"2016-02-03T13:07:05Z","pushed_at":"2016-02-03T15:08:44Z","git_url":"git://github.com/Automattic/wp-calypso.git","ssh_url":"git@github.com:Automattic/wp-calypso.git","clone_url":"https://github.com/Automattic/wp-calypso.git","svn_url":"https://github.com/Automattic/wp-calypso","homepage":"https://developer.wordpress.com/calypso/","size":53937,"stargazers_count":6735,"watchers_count":6735,"language":"JavaScript","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":759,"mirror_url":null,"open_issues_count":1209,"forks":759,"open_issues":1209,"watchers":6735,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002"},"html":{"href":"https://github.com/Automattic/wp-calypso/pull/3002"},"issue":{"href":"https://api.github.com/repos/Automattic/wp-calypso/issues/3002"},"comments":{"href":"https://api.github.com/repos/Automattic/wp-calypso/issues/3002/comments"},"review_comments":{"href":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002/comments"},"review_comment":{"href":"https://api.github.com/repos/Automattic/wp-calypso/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/Automattic/wp-calypso/pulls/3002/commits"},"statuses":{"href":"https://api.github.com/repos/Automattic/wp-calypso/statuses/8bb50797df3a4f52f3ac38f7cad1c7add6aaa741"}}}}