{"action":"created","issue":{"url":"https://api.github.com/repos/alphagov/paas-cf/issues/418","repository_url":"https://api.github.com/repos/alphagov/paas-cf","labels_url":"https://api.github.com/repos/alphagov/paas-cf/issues/418/labels{/name}","comments_url":"https://api.github.com/repos/alphagov/paas-cf/issues/418/comments","events_url":"https://api.github.com/repos/alphagov/paas-cf/issues/418/events","html_url":"https://github.com/alphagov/paas-cf/pull/418","id":170662265,"number":418,"title":"[#121566765] Fix and disable bosh resurrector","user":{"login":"keymon","id":280032,"avatar_url":"https://avatars.githubusercontent.com/u/280032?v=3","gravatar_id":"","url":"https://api.github.com/users/keymon","html_url":"https://github.com/keymon","followers_url":"https://api.github.com/users/keymon/followers","following_url":"https://api.github.com/users/keymon/following{/other_user}","gists_url":"https://api.github.com/users/keymon/gists{/gist_id}","starred_url":"https://api.github.com/users/keymon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keymon/subscriptions","organizations_url":"https://api.github.com/users/keymon/orgs","repos_url":"https://api.github.com/users/keymon/repos","events_url":"https://api.github.com/users/keymon/events{/privacy}","received_events_url":"https://api.github.com/users/keymon/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"mtekel","id":483891,"avatar_url":"https://avatars.githubusercontent.com/u/483891?v=3","gravatar_id":"","url":"https://api.github.com/users/mtekel","html_url":"https://github.com/mtekel","followers_url":"https://api.github.com/users/mtekel/followers","following_url":"https://api.github.com/users/mtekel/following{/other_user}","gists_url":"https://api.github.com/users/mtekel/gists{/gist_id}","starred_url":"https://api.github.com/users/mtekel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mtekel/subscriptions","organizations_url":"https://api.github.com/users/mtekel/orgs","repos_url":"https://api.github.com/users/mtekel/repos","events_url":"https://api.github.com/users/mtekel/events{/privacy}","received_events_url":"https://api.github.com/users/mtekel/received_events","type":"User","site_admin":false},"assignees":[{"login":"mtekel","id":483891,"avatar_url":"https://avatars.githubusercontent.com/u/483891?v=3","gravatar_id":"","url":"https://api.github.com/users/mtekel","html_url":"https://github.com/mtekel","followers_url":"https://api.github.com/users/mtekel/followers","following_url":"https://api.github.com/users/mtekel/following{/other_user}","gists_url":"https://api.github.com/users/mtekel/gists{/gist_id}","starred_url":"https://api.github.com/users/mtekel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mtekel/subscriptions","organizations_url":"https://api.github.com/users/mtekel/orgs","repos_url":"https://api.github.com/users/mtekel/repos","events_url":"https://api.github.com/users/mtekel/events{/privacy}","received_events_url":"https://api.github.com/users/mtekel/received_events","type":"User","site_admin":false}],"milestone":null,"comments":5,"created_at":"2016-08-11T14:39:53Z","updated_at":"2016-08-12T12:18:31Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/alphagov/paas-cf/pulls/418","html_url":"https://github.com/alphagov/paas-cf/pull/418","diff_url":"https://github.com/alphagov/paas-cf/pull/418.diff","patch_url":"https://github.com/alphagov/paas-cf/pull/418.patch"},"body":"What\r\n===\r\nWe are not sure if we want to use the features covered by Bosh Resurrector. Meanwhile we do [Spike to determine if we want to use it](https://www.pivotaltracker.com/n/projects/1275640/stories/119516757), we will disable the feature.\r\n\r\nBut the feature was broken because an incorrect password, so we will fix it before disable it.\r\n\r\n\r\nHow to test?\r\n-------\r\n\r\nFirst test that resurrector is fixed by:\r\n\r\n 1. Create a custom branch reverting the last commit\r\n    ```\r\ngit checkout -b resurrector_wip\r\ngit revert HEAD\r\ngit push\r\n```\r\n\r\n 2. Deploy bosh running the pipeline (see README.md)\r\n   ```\r\nBRANCH=$(git rev-parse --abbrev-ref HEAD) make dev pipelines DEPLOY_ENV=...\r\n```\r\n\r\n 3. SSH on the bosh machine (via concourse) and check that the logs indicate that resurrector is working:\r\n\r\n    ```\r\n$ less /var/vcap/sys/log/health_monitor/health_monitor.log\r\n...\r\nI, [2016-08-11T14:37:07.946532 #19625]  INFO : Adding agent 547e8bff-aa6b-4efc-9b6c-29136e04071b (elasticsearch_master/553475a7-1c63-4633-9ff8-b71bf63bcf46) to hector...\r\nI, [2016-08-11T14:37:07.946579 #19625]  INFO : Adding agent 9cec89fc-1f50-43f7-9546-ffcd86506c90 (elasticsearch_master/38ab835e-9319-452a-95be-47a79930bd37) to hector...\r\nI, [2016-08-11T14:37:07.946629 #19625]  INFO : Adding agent 9b834ea3-8275-4a86-8e29-8da4b36a7945 (maintenance/eff717f7-8ba8-45f6-afda-fc77c3780236) to hector...\r\nI, [2016-08-11T14:37:07.946676 #19625]  INFO : Adding agent e607d566-58ac-425e-92e2-d47dc1f425b2 (rds_broker/71e94328-b348-49c9-a004-440be55ab04b) to hector...\r\nI, [2016-08-11T14:37:07.946721 #19625]  INFO : Adding agent 29b4ab30-f983-4a66-aff9-0bf6e45f98f0 (parser_z2/8259c347-cfce-43b9-be43-4e4ca1e68e6b) to hector...\r\nI, [2016-08-11T14:37:07.946792 #19625]  INFO : Adding agent c26e4b4b-ce6d-476a-a478-7122e89e8c83 (queue/2a1e103a-be3b-49b7-a151-d6950cb1efcf) to hector...\r\nI, [2016-08-11T14:37:07.981550 #19625]  INFO : [ALERT] Alert @ 2016-08-11 14:37:07 UTC, severity 1: process is not running\r\nW, [2016-08-11T14:37:07.981627 #19625]  WARN : (Resurrector) event did not have deployment, job and id: Alert @ 2016-08-11 14:37:07 UTC, severity 1: process is not running\r\nI, [2016-08-11T14:37:08.184654 #19625]  INFO : Managing 1 deployment, 47 agents\r\nI, [2016-08-11T14:37:08.184767 #19625]  INFO : Agent heartbeats received = 170\r\nI, [2016-08-11T14:37:09.033584 #19625]  INFO : [ALERT] Alert @ 2016-08-11 14:37:08 UTC, severity 1: process is not running\r\nW, [2016-08-11T14:37:09.033710 #19625]  WARN : (Resurrector) event did not have deployment, job and id: Alert @ 2016-08-11 14:37:08 UTC, severity 1: process is not running\r\nI, [2016-08-11T14:37:21.900812 #19625]  INFO : Agent `30c2ebbf-e414-4faa-a482-9d14131b61a0' shutting down...\r\nI, [2016-08-11T14:37:21.900906 #19625]  INFO : Removing agent 30c2ebbf-e414-4faa-a482-9d14131b61a0 from all deployments...\r\n```\r\n\r\nSecond, try to deploy the branch. To do so:\r\n\r\n 1. Checkout the original branch `git checkout bugfix/121566765_turn_off_bosh_resurrector`\r\n 2. Redeploy bosh: `BRANCH=$(git rev-parse --abbrev-ref HEAD) make dev pipelines DEPLOY_ENV=...`\r\n 3. check the log, to see if the resurrector is disabled.\r\n\r\nWho?\r\n----\r\n\r\nAnyone but @keymon"},"comment":{"url":"https://api.github.com/repos/alphagov/paas-cf/issues/comments/239431451","html_url":"https://github.com/alphagov/paas-cf/pull/418#issuecomment-239431451","issue_url":"https://api.github.com/repos/alphagov/paas-cf/issues/418","id":239431451,"user":{"login":"keymon","id":280032,"avatar_url":"https://avatars.githubusercontent.com/u/280032?v=3","gravatar_id":"","url":"https://api.github.com/users/keymon","html_url":"https://github.com/keymon","followers_url":"https://api.github.com/users/keymon/followers","following_url":"https://api.github.com/users/keymon/following{/other_user}","gists_url":"https://api.github.com/users/keymon/gists{/gist_id}","starred_url":"https://api.github.com/users/keymon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keymon/subscriptions","organizations_url":"https://api.github.com/users/keymon/orgs","repos_url":"https://api.github.com/users/keymon/repos","events_url":"https://api.github.com/users/keymon/events{/privacy}","received_events_url":"https://api.github.com/users/keymon/received_events","type":"User","site_admin":false},"created_at":"2016-08-12T12:18:31Z","updated_at":"2016-08-12T12:18:31Z","body":"I am worried if we are not not disabling it because this code:\r\n\r\nhttps://github.com/cloudfoundry/bosh/blob/master/release/jobs/health_monitor/templates/health_monitor.yml.erb#L121\r\n\r\nI am setting the property to \"false\", but maybe that is string that evaluates `true`. I am trying to test it."}}
{"actor":{"display_login":"keymon"}}