{"action":"created","issue":{"url":"https://api.github.com/repos/rcbops/rpc-openstack/issues/192","repository_url":"https://api.github.com/repos/rcbops/rpc-openstack","labels_url":"https://api.github.com/repos/rcbops/rpc-openstack/issues/192/labels{/name}","comments_url":"https://api.github.com/repos/rcbops/rpc-openstack/issues/192/comments","events_url":"https://api.github.com/repos/rcbops/rpc-openstack/issues/192/events","html_url":"https://github.com/rcbops/rpc-openstack/issues/192","id":91046261,"number":192,"title":"neutron_linuxbridge_agent_check, nova-compute check execute only once and iterate over hostnames","user":{"login":"BjoernT","id":5613435,"avatar_url":"https://avatars.githubusercontent.com/u/5613435?v=3","gravatar_id":"","url":"https://api.github.com/users/BjoernT","html_url":"https://github.com/BjoernT","followers_url":"https://api.github.com/users/BjoernT/followers","following_url":"https://api.github.com/users/BjoernT/following{/other_user}","gists_url":"https://api.github.com/users/BjoernT/gists{/gist_id}","starred_url":"https://api.github.com/users/BjoernT/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BjoernT/subscriptions","organizations_url":"https://api.github.com/users/BjoernT/orgs","repos_url":"https://api.github.com/users/BjoernT/repos","events_url":"https://api.github.com/users/BjoernT/events{/privacy}","received_events_url":"https://api.github.com/users/BjoernT/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/rcbops/rpc-openstack/labels/backport-potential-kilo","name":"backport-potential-kilo","color":"207de5"},{"url":"https://api.github.com/repos/rcbops/rpc-openstack/labels/impacts-maas","name":"impacts-maas","color":"d4c5f9"},{"url":"https://api.github.com/repos/rcbops/rpc-openstack/labels/prio-1","name":"prio-1","color":"eb6420"},{"url":"https://api.github.com/repos/rcbops/rpc-openstack/labels/status-doing","name":"status-doing","color":"cccccc"},{"url":"https://api.github.com/repos/rcbops/rpc-openstack/labels/type-bug","name":"type-bug","color":"84b6eb"}],"state":"closed","locked":false,"assignee":{"login":"mancdaz","id":562262,"avatar_url":"https://avatars.githubusercontent.com/u/562262?v=3","gravatar_id":"","url":"https://api.github.com/users/mancdaz","html_url":"https://github.com/mancdaz","followers_url":"https://api.github.com/users/mancdaz/followers","following_url":"https://api.github.com/users/mancdaz/following{/other_user}","gists_url":"https://api.github.com/users/mancdaz/gists{/gist_id}","starred_url":"https://api.github.com/users/mancdaz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mancdaz/subscriptions","organizations_url":"https://api.github.com/users/mancdaz/orgs","repos_url":"https://api.github.com/users/mancdaz/repos","events_url":"https://api.github.com/users/mancdaz/events{/privacy}","received_events_url":"https://api.github.com/users/mancdaz/received_events","type":"User","site_admin":false},"milestone":null,"comments":19,"created_at":"2015-06-25T18:51:59Z","updated_at":"2016-06-01T14:33:36Z","closed_at":"2016-06-01T14:33:36Z","body":"Currently we do see massive burst of alerts in case something is off with the neutron server or any other central service. The issue primarily with the bursts are that we check the neutron agent per compute node instead of executing the check on the infra nodes and iteration over all agents and looking for downed neutron agents with just one api call.\r\nThe goal is:\r\n- Remove neutron_linuxbridge_agent_check and nova-compute from all compute nodes\r\n- Add the neutron_linuxbridge_agent_check and nova-compute  to the infra nodes\r\n- Issue one api call (agent-list) and check for all agents which are enabled but not marked as alive\r\n\r\nPersonally I would just name this check neutral like neutron_agent_alive_check and we just report the dead components in one alert.\r\nThis needs to be back ported to Kilo and Juno"},"comment":{"url":"https://api.github.com/repos/rcbops/rpc-openstack/issues/comments/223011630","html_url":"https://github.com/rcbops/rpc-openstack/issues/192#issuecomment-223011630","issue_url":"https://api.github.com/repos/rcbops/rpc-openstack/issues/192","id":223011630,"user":{"login":"BjoernT","id":5613435,"avatar_url":"https://avatars.githubusercontent.com/u/5613435?v=3","gravatar_id":"","url":"https://api.github.com/users/BjoernT","html_url":"https://github.com/BjoernT","followers_url":"https://api.github.com/users/BjoernT/followers","following_url":"https://api.github.com/users/BjoernT/following{/other_user}","gists_url":"https://api.github.com/users/BjoernT/gists{/gist_id}","starred_url":"https://api.github.com/users/BjoernT/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BjoernT/subscriptions","organizations_url":"https://api.github.com/users/BjoernT/orgs","repos_url":"https://api.github.com/users/BjoernT/repos","events_url":"https://api.github.com/users/BjoernT/events{/privacy}","received_events_url":"https://api.github.com/users/BjoernT/received_events","type":"User","site_admin":false},"created_at":"2016-06-01T14:33:36Z","updated_at":"2016-06-01T14:33:36Z","body":"Yes i know it is difficult, but not getting an alarm if nova-compute and the node goes down is also bad. Neither solutions are perfect. Since we implemented a agent down in RPC-Support, outside of the MAAS team, we will utilize this and leave the checks as they are. It seems we get out of this chicken-egg problem only with two checks, nova and agent health. Hopefully agent health checks in MAAS will work this decade ... until then we fix it in RPC with our own tools. So we can close this issue"}}
{"actor":{"display_login":"BjoernT"}}