{"action":"created","issue":{"url":"https://api.github.com/repos/prometheus/alertmanager/issues/1814","repository_url":"https://api.github.com/repos/prometheus/alertmanager","labels_url":"https://api.github.com/repos/prometheus/alertmanager/issues/1814/labels{/name}","comments_url":"https://api.github.com/repos/prometheus/alertmanager/issues/1814/comments","events_url":"https://api.github.com/repos/prometheus/alertmanager/issues/1814/events","html_url":"https://github.com/prometheus/alertmanager/issues/1814","id":425841695,"node_id":"MDU6SXNzdWU0MjU4NDE2OTU=","number":1814,"title":"\"dropping messages because too many are queued\" error in a single-node cluster","user":{"login":"simonpasquier","id":2587585,"node_id":"MDQ6VXNlcjI1ODc1ODU=","avatar_url":"https://avatars1.githubusercontent.com/u/2587585?v=4","gravatar_id":"","url":"https://api.github.com/users/simonpasquier","html_url":"https://github.com/simonpasquier","followers_url":"https://api.github.com/users/simonpasquier/followers","following_url":"https://api.github.com/users/simonpasquier/following{/other_user}","gists_url":"https://api.github.com/users/simonpasquier/gists{/gist_id}","starred_url":"https://api.github.com/users/simonpasquier/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/simonpasquier/subscriptions","organizations_url":"https://api.github.com/users/simonpasquier/orgs","repos_url":"https://api.github.com/users/simonpasquier/repos","events_url":"https://api.github.com/users/simonpasquier/events{/privacy}","received_events_url":"https://api.github.com/users/simonpasquier/received_events","type":"User","site_admin":false},"labels":[{"id":394362225,"node_id":"MDU6TGFiZWwzOTQzNjIyMjU=","url":"https://api.github.com/repos/prometheus/alertmanager/labels/component/high%20availability","name":"component/high availability","color":"0052cc","default":false},{"id":365051352,"node_id":"MDU6TGFiZWwzNjUwNTEzNTI=","url":"https://api.github.com/repos/prometheus/alertmanager/labels/kind/bug","name":"kind/bug","color":"ff0000","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2019-03-27T09:13:49Z","updated_at":"2019-07-23T14:29:04Z","closed_at":null,"author_association":"MEMBER","body":"It appears that AlertManager in a single-node setup will try to broadcast silences and notification logs to itself. The messages are queued forever, leading to the aforementioned error message when it reaches the max queue size. A workaround is to start AlertManager with `--cluster.listen-address=\"\"` which disables clustering altogether.\r\n\r\n![image](https://user-images.githubusercontent.com/2587585/55063680-cd2bad00-5078-11e9-871f-f3fb2aced605.png)\r\n\r\nReported by @sylr on IRC and reproduced on master."},"comment":{"url":"https://api.github.com/repos/prometheus/alertmanager/issues/comments/514234815","html_url":"https://github.com/prometheus/alertmanager/issues/1814#issuecomment-514234815","issue_url":"https://api.github.com/repos/prometheus/alertmanager/issues/1814","id":514234815,"node_id":"MDEyOklzc3VlQ29tbWVudDUxNDIzNDgxNQ==","user":{"login":"simonpasquier","id":2587585,"node_id":"MDQ6VXNlcjI1ODc1ODU=","avatar_url":"https://avatars1.githubusercontent.com/u/2587585?v=4","gravatar_id":"","url":"https://api.github.com/users/simonpasquier","html_url":"https://github.com/simonpasquier","followers_url":"https://api.github.com/users/simonpasquier/followers","following_url":"https://api.github.com/users/simonpasquier/following{/other_user}","gists_url":"https://api.github.com/users/simonpasquier/gists{/gist_id}","starred_url":"https://api.github.com/users/simonpasquier/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/simonpasquier/subscriptions","organizations_url":"https://api.github.com/users/simonpasquier/orgs","repos_url":"https://api.github.com/users/simonpasquier/repos","events_url":"https://api.github.com/users/simonpasquier/events{/privacy}","received_events_url":"https://api.github.com/users/simonpasquier/received_events","type":"User","site_admin":false},"created_at":"2019-07-23T14:29:04Z","updated_at":"2019-07-23T14:29:04Z","author_association":"MEMBER","body":"@bwplotka the [trick](https://github.com/prometheus/alertmanager#disabling-high-availability) is to set `--cluster.listen-address=\"\"`."}}
{"actor":{"display_login":"simonpasquier"}}