{"action":"opened","issue":{"url":"https://api.github.com/repos/mozilla-iam/eks-deployment/issues/13","repository_url":"https://api.github.com/repos/mozilla-iam/eks-deployment","labels_url":"https://api.github.com/repos/mozilla-iam/eks-deployment/issues/13/labels{/name}","comments_url":"https://api.github.com/repos/mozilla-iam/eks-deployment/issues/13/comments","events_url":"https://api.github.com/repos/mozilla-iam/eks-deployment/issues/13/events","html_url":"https://github.com/mozilla-iam/eks-deployment/issues/13","id":348803785,"node_id":"MDU6SXNzdWUzNDg4MDM3ODU=","number":13,"title":"monitor Kubernetes node status","user":{"login":"danielhartnell","id":322152,"node_id":"MDQ6VXNlcjMyMjE1Mg==","avatar_url":"https://avatars0.githubusercontent.com/u/322152?v=4","gravatar_id":"","url":"https://api.github.com/users/danielhartnell","html_url":"https://github.com/danielhartnell","followers_url":"https://api.github.com/users/danielhartnell/followers","following_url":"https://api.github.com/users/danielhartnell/following{/other_user}","gists_url":"https://api.github.com/users/danielhartnell/gists{/gist_id}","starred_url":"https://api.github.com/users/danielhartnell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danielhartnell/subscriptions","organizations_url":"https://api.github.com/users/danielhartnell/orgs","repos_url":"https://api.github.com/users/danielhartnell/repos","events_url":"https://api.github.com/users/danielhartnell/events{/privacy}","received_events_url":"https://api.github.com/users/danielhartnell/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-08T16:37:38Z","updated_at":"2018-08-08T16:37:38Z","closed_at":null,"author_association":"COLLABORATOR","body":"Today I found that one of the nodes in our development cluster had entered into a `NotReady` state. Next time I'll need to track down relevant logs but for now, I terminated the instance. The ASG automatically replaced the node and it automatically joined the cluster which was nice.\r\n\r\nMoving forward, it would be nice to have some monitoring tell us if a node is unhealthy. We should also have a runbook that documents troubleshooting steps if this happens to a node."}}
{"actor":{"display_login":"danielhartnell"}}