{"action":"created","issue":{"url":"https://api.github.com/repos/helm/charts/issues/14286","repository_url":"https://api.github.com/repos/helm/charts","labels_url":"https://api.github.com/repos/helm/charts/issues/14286/labels{/name}","comments_url":"https://api.github.com/repos/helm/charts/issues/14286/comments","events_url":"https://api.github.com/repos/helm/charts/issues/14286/events","html_url":"https://github.com/helm/charts/issues/14286","id":449897358,"node_id":"MDU6SXNzdWU0NDk4OTczNTg=","number":14286,"title":"[stable/prometheus-operator] alert manager nodes die, error no such host","user":{"login":"MaxDiOrio","id":25855524,"node_id":"MDQ6VXNlcjI1ODU1NTI0","avatar_url":"https://avatars2.githubusercontent.com/u/25855524?v=4","gravatar_id":"","url":"https://api.github.com/users/MaxDiOrio","html_url":"https://github.com/MaxDiOrio","followers_url":"https://api.github.com/users/MaxDiOrio/followers","following_url":"https://api.github.com/users/MaxDiOrio/following{/other_user}","gists_url":"https://api.github.com/users/MaxDiOrio/gists{/gist_id}","starred_url":"https://api.github.com/users/MaxDiOrio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MaxDiOrio/subscriptions","organizations_url":"https://api.github.com/users/MaxDiOrio/orgs","repos_url":"https://api.github.com/users/MaxDiOrio/repos","events_url":"https://api.github.com/users/MaxDiOrio/events{/privacy}","received_events_url":"https://api.github.com/users/MaxDiOrio/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2019-05-29T16:09:49Z","updated_at":"2019-05-30T16:00:55Z","closed_at":"2019-05-30T16:00:55Z","author_association":"NONE","body":"**Describe the bug**\r\nWhen deploying a new instance of prometheus-operator, the Alertmanager pods die repeatedly with the following errors:\r\n\r\ncomponent=cluster msg=\"failed to join cluster\" err=\"2 errors occurred:\\n\\t* Failed to resolve alertmanager-kindly-magpie-prometheus-o-alertmanager-0.alertmanager-operated.default.svc:6783: lookup alertmanager-kindly-magpie-prometheus-o-alertmanager-0.alertmanager-operated.default.svc on 10.43.0.10:53: no such host\\n\\t* Failed to resolve alertmanager-kindly-magpie-prometheus-o-alertmanager-1.alertmanager-operated.default.svc:6783: lookup alertmanager-kindly-magpie-prometheus-o-alertmanager-1.alertmanager-operated.default.svc on 10.43.0.10:53: no such host\\n\\n\"\r\n\r\n**Version of Helm and Kubernetes**:\r\nHelm v2.14.0\r\nK8S:  v1.11.6\r\n\r\n**Which chart**:\r\nstable/prometheus-operator\r\n\r\n**What happened**:\r\nAlert manager pods die repeatedly with the above error.  This appears to force the prometheus container to also die as it can't post to alert manager.  \r\n\r\nIf you look at service discovery, Alertmanager-operated has no IP's associated with it.\r\n\r\nThe DNS name that it is looking up also appears wrong as there is no cluster.local at the end. \r\n\r\n**What you expected to happen**:\r\n\r\nPods should turn up without an issue.\r\n\r\n**How to reproduce it** (as minimally and precisely as possible):\r\nRunning a Rancher cluster, have never had an issue deploying helm charts before.\r\n\r\nDid a helm install stable/prometheus-operator -f prometheus-operator.yaml\r\n\r\nThe yaml is my answer file, which is default except for my thanos config section.\r\n\r\n**Anything else we need to know**:\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/helm/charts/issues/comments/497383087","html_url":"https://github.com/helm/charts/issues/14286#issuecomment-497383087","issue_url":"https://api.github.com/repos/helm/charts/issues/14286","id":497383087,"node_id":"MDEyOklzc3VlQ29tbWVudDQ5NzM4MzA4Nw==","user":{"login":"MaxDiOrio","id":25855524,"node_id":"MDQ6VXNlcjI1ODU1NTI0","avatar_url":"https://avatars2.githubusercontent.com/u/25855524?v=4","gravatar_id":"","url":"https://api.github.com/users/MaxDiOrio","html_url":"https://github.com/MaxDiOrio","followers_url":"https://api.github.com/users/MaxDiOrio/followers","following_url":"https://api.github.com/users/MaxDiOrio/following{/other_user}","gists_url":"https://api.github.com/users/MaxDiOrio/gists{/gist_id}","starred_url":"https://api.github.com/users/MaxDiOrio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MaxDiOrio/subscriptions","organizations_url":"https://api.github.com/users/MaxDiOrio/orgs","repos_url":"https://api.github.com/users/MaxDiOrio/repos","events_url":"https://api.github.com/users/MaxDiOrio/events{/privacy}","received_events_url":"https://api.github.com/users/MaxDiOrio/received_events","type":"User","site_admin":false},"created_at":"2019-05-30T16:00:55Z","updated_at":"2019-05-30T16:00:55Z","author_association":"NONE","body":"Looks like someone had another instance"}}
{"actor":{"display_login":"MaxDiOrio"}}