{"action":"created","issue":{"url":"https://api.github.com/repos/istio/istio/issues/3533","repository_url":"https://api.github.com/repos/istio/istio","labels_url":"https://api.github.com/repos/istio/istio/issues/3533/labels{/name}","comments_url":"https://api.github.com/repos/istio/istio/issues/3533/comments","events_url":"https://api.github.com/repos/istio/istio/issues/3533/events","html_url":"https://github.com/istio/istio/issues/3533","id":297611484,"number":3533,"title":"(I believe) The startup time of istio-proxy causes some communications issues for up to 30s with the kubernetes API","user":{"login":"Stono","id":1486729,"avatar_url":"https://avatars2.githubusercontent.com/u/1486729?v=4","gravatar_id":"","url":"https://api.github.com/users/Stono","html_url":"https://github.com/Stono","followers_url":"https://api.github.com/users/Stono/followers","following_url":"https://api.github.com/users/Stono/following{/other_user}","gists_url":"https://api.github.com/users/Stono/gists{/gist_id}","starred_url":"https://api.github.com/users/Stono/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Stono/subscriptions","organizations_url":"https://api.github.com/users/Stono/orgs","repos_url":"https://api.github.com/users/Stono/repos","events_url":"https://api.github.com/users/Stono/events{/privacy}","received_events_url":"https://api.github.com/users/Stono/received_events","type":"User","site_admin":false},"labels":[{"id":735781806,"url":"https://api.github.com/repos/istio/istio/labels/area/networking","name":"area/networking","color":"0e8a16","default":false},{"id":822212191,"url":"https://api.github.com/repos/istio/istio/labels/kind/customer%20issue","name":"kind/customer issue","color":"fbca04","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-02-15T21:59:31Z","updated_at":"2018-02-17T16:23:57Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Hey, \r\nI'm not sure if there's a huge amount you can do about this one...\r\n\r\nIf you read through https://github.com/kubernetes/ingress-nginx/issues/1968 - you will see that the `nginx-ingress-controller` attempts to query the kubernetes api (kubernetes.default.svc.cluster.local) for the version almost immediately when it boots, and it retries for around **30 seconds** before its' actually able to successfully get a response.\r\n\r\nThe `nginx-ingress-controller` connects first time when it is started without istio-proxy.\r\n\r\nWe worked around this by adding a retry/delay into the controller to give istio-proxy time to \"boot\", but it feels like something we shouldn't really need to be doing?\r\n\r\nCould this be because istio-proxy is taking a while to sync the config that says `mtlsExcludedServices: kubernetes.default.svc.cluster.local`? \r\n\r\nThoughts?"},"comment":{"url":"https://api.github.com/repos/istio/istio/issues/comments/366452304","html_url":"https://github.com/istio/istio/issues/3533#issuecomment-366452304","issue_url":"https://api.github.com/repos/istio/istio/issues/3533","id":366452304,"user":{"login":"costinm","id":84202,"avatar_url":"https://avatars1.githubusercontent.com/u/84202?v=4","gravatar_id":"","url":"https://api.github.com/users/costinm","html_url":"https://github.com/costinm","followers_url":"https://api.github.com/users/costinm/followers","following_url":"https://api.github.com/users/costinm/following{/other_user}","gists_url":"https://api.github.com/users/costinm/gists{/gist_id}","starred_url":"https://api.github.com/users/costinm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/costinm/subscriptions","organizations_url":"https://api.github.com/users/costinm/orgs","repos_url":"https://api.github.com/users/costinm/repos","events_url":"https://api.github.com/users/costinm/events{/privacy}","received_events_url":"https://api.github.com/users/costinm/received_events","type":"User","site_admin":false},"created_at":"2018-02-17T16:23:57Z","updated_at":"2018-02-17T16:23:57Z","author_association":"CONTRIBUTOR","body":"Interesting - if this helps we should definitely add it to the default\nconfig.\n\nBut I would add it as a handler to the pilot agent, which also needs to\nfetch\nAZ.\n\nNote that we made few changes to pilot to make it load faster - the\ntime for 1000 services went from >100 sec to ~3 in one test, but we should\nstill add readiness/liveness probes.\n\nOn Sat, Feb 17, 2018 at 4:22 AM, Karl Stoney <notifications@github.com>\nwrote:\n\n> @rshriram <https://github.com/rshriram> that seems to resolve it, adding:\n>\n>          livenessProbe:\n>            exec:\n>              command:\n>              - curl\n>              - -f\n>              - http://istio-pilot.istio-system:8080/v1/registration\n>\n> As a livenessProbe to the istio-proxy container seems to fix is.\n>\n> Can i just validate my understanding of what is going on here, does\n> curling /v1/registration force pilot to reload its configuration from\n> kube?\n>\n> It that's the case, wouldn't it make sense to have envoy call this as soon\n> as it boots, because it's a \"new\" things that pilot needs to pick up?\n>\n> —\n> You are receiving this because you are subscribed to this thread.\n> Reply to this email directly, view it on GitHub\n> <https://github.com/istio/istio/issues/3533#issuecomment-366437869>, or mute\n> the thread\n> <https://github.com/notifications/unsubscribe-auth/AAFI6iHgN8ssebHnlA7bgrrTXUqPYdUMks5tVsSTgaJpZM4SHkjh>\n> .\n>\n"}}
{"actor":{"display_login":"costinm"}}