{"action":"created","issue":{"url":"https://api.github.com/repos/gliderlabs/registrator/issues/190","repository_url":"https://api.github.com/repos/gliderlabs/registrator","labels_url":"https://api.github.com/repos/gliderlabs/registrator/issues/190/labels{/name}","comments_url":"https://api.github.com/repos/gliderlabs/registrator/issues/190/comments","events_url":"https://api.github.com/repos/gliderlabs/registrator/issues/190/events","html_url":"https://github.com/gliderlabs/registrator/issues/190","id":83692914,"number":190,"title":"Old services left over! And extra services??","user":{"login":"MrMMorris","id":1494248,"avatar_url":"https://avatars.githubusercontent.com/u/1494248?v=3","gravatar_id":"","url":"https://api.github.com/users/MrMMorris","html_url":"https://github.com/MrMMorris","followers_url":"https://api.github.com/users/MrMMorris/followers","following_url":"https://api.github.com/users/MrMMorris/following{/other_user}","gists_url":"https://api.github.com/users/MrMMorris/gists{/gist_id}","starred_url":"https://api.github.com/users/MrMMorris/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MrMMorris/subscriptions","organizations_url":"https://api.github.com/users/MrMMorris/orgs","repos_url":"https://api.github.com/users/MrMMorris/repos","events_url":"https://api.github.com/users/MrMMorris/events{/privacy}","received_events_url":"https://api.github.com/users/MrMMorris/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":15,"created_at":"2015-06-01T21:04:05Z","updated_at":"2016-06-12T17:31:00Z","closed_at":"2015-06-22T20:01:42Z","body":"I have run into a **major** issue a couple times where old services that don't exist still show as 'passing' in consul.\r\n\r\nThe latest instance was I took a container with `SERVICE_NAME=mongo` and stop/rm'd it. I then started a similar container with `SERVICE_NAME=app-mongo`. That's where the problem starts...\r\n\r\nNow consul is showing 4 'app-mongo' services (when there are only 2) and 2 **passing** 'mongo' services (no containers with `SERVICE_NAME=mongo` exist anymore).\r\n\r\nThis is a pretty big problem... I am at risk of requests going to non-existent services :crying_cat_face: \r\n\r\nAny ideas what might be causing this? Might it be fixed with the health check refactors? Should I use a more robust health check type?\r\n\r\nI tried stopping/rming the registrator container, but that didn't work.\r\n\r\nI am running the 'master' tag"},"comment":{"url":"https://api.github.com/repos/gliderlabs/registrator/issues/comments/225449708","html_url":"https://github.com/gliderlabs/registrator/issues/190#issuecomment-225449708","issue_url":"https://api.github.com/repos/gliderlabs/registrator/issues/190","id":225449708,"user":{"login":"cohenaj194","id":17516896,"avatar_url":"https://avatars.githubusercontent.com/u/17516896?v=3","gravatar_id":"","url":"https://api.github.com/users/cohenaj194","html_url":"https://github.com/cohenaj194","followers_url":"https://api.github.com/users/cohenaj194/followers","following_url":"https://api.github.com/users/cohenaj194/following{/other_user}","gists_url":"https://api.github.com/users/cohenaj194/gists{/gist_id}","starred_url":"https://api.github.com/users/cohenaj194/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cohenaj194/subscriptions","organizations_url":"https://api.github.com/users/cohenaj194/orgs","repos_url":"https://api.github.com/users/cohenaj194/repos","events_url":"https://api.github.com/users/cohenaj194/events{/privacy}","received_events_url":"https://api.github.com/users/cohenaj194/received_events","type":"User","site_admin":false},"created_at":"2016-06-12T17:31:00Z","updated_at":"2016-06-12T17:31:00Z","body":"Yea it was just a temporary fix for testing purposes.  The real fix is to\nmake a script  that recognizes when a service exists for a container that\ndoes not exist, the script then has to removes the offending service from\nconsul.\n\nAlso using the http api for removing services is much nicer.  I just\nfigured out how to manually remove services before I figured out how to use\nthe https api.\nOn Jun 12, 2016 9:30 AM, \"Ashesh Ambasta\" <notifications@github.com> wrote:\n\n@cohenaj194 <https://github.com/cohenaj194> that isn't a resolution is it?\nWe cannot keep manually checking for each of these *ghost* services\nmanually and deleting them when we find them.\n\nThe whole point was to get things automated. We are seeing the same issue –\na container is stopped and restarted with obviously different ports, and\nconsul keeps them registered.\n\nThat in turn, completely messes up consul-template which we are using to\nregenerate nginx configuration files to proxy requests to the destination\nservices.\n\n—\nYou are receiving this because you were mentioned.\nReply to this email directly, view it on GitHub\n<https://github.com/gliderlabs/registrator/issues/190#issuecomment-225446561>,\nor mute the thread\n<https://github.com/notifications/unsubscribe/AQtJYCQY2ZwjCbPGcXaVIb3iI9bjIGtLks5qLDQ-gaJpZM4Eze57>\n.\n"}}
{"actor":{"display_login":"cohenaj194"}}