{"action":"created","issue":{"url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release/issues/277","repository_url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release","labels_url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release/issues/277/labels{/name}","comments_url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release/issues/277/comments","events_url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release/issues/277/events","html_url":"https://github.com/cloudfoundry-incubator/kubo-release/issues/277","id":381305828,"node_id":"MDU6SXNzdWUzODEzMDU4Mjg=","number":277,"title":"Kube Proxy hostname override causes service.spec.externalTrafficPolicy=Local to fail","user":{"login":"jostockley","id":11546796,"node_id":"MDQ6VXNlcjExNTQ2Nzk2","avatar_url":"https://avatars2.githubusercontent.com/u/11546796?v=4","gravatar_id":"","url":"https://api.github.com/users/jostockley","html_url":"https://github.com/jostockley","followers_url":"https://api.github.com/users/jostockley/followers","following_url":"https://api.github.com/users/jostockley/following{/other_user}","gists_url":"https://api.github.com/users/jostockley/gists{/gist_id}","starred_url":"https://api.github.com/users/jostockley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jostockley/subscriptions","organizations_url":"https://api.github.com/users/jostockley/orgs","repos_url":"https://api.github.com/users/jostockley/repos","events_url":"https://api.github.com/users/jostockley/events{/privacy}","received_events_url":"https://api.github.com/users/jostockley/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-11-15T19:26:59Z","updated_at":"2018-11-15T20:09:12Z","closed_at":null,"author_association":"NONE","body":"<!--\r\nThis form is for bug reports ONLY!\r\n\r\nIf you're looking for Kubernetes-specific help check [Stack Overflow](https://stackoverflow.com/questions/tagged/kubernetes)\r\nand the [troubleshooting guide](https://kubernetes.io/docs/tasks/debug-application-cluster/troubleshooting/).\r\n-->\r\n\r\n**What happened**:\r\nWhen following the tutorial [here](https://kubernetes.io/docs/tutorials/services/source-ip/#source-ip-for-services-with-type-nodeport) the client cannot connect. This appear to be the same problem as seen on azure and fixed with [this PR](https://github.com/cloudfoundry-incubator/kubo-release/pull/257). However in our case we are using vSphere Cloud Provider.\r\n\r\n**What you expected to happen**:\r\nFollowing the tutorial should work.\r\n**How to reproduce it (as minimally and precisely as possible)**:\r\nUsing vSphere Cloud Provider, follow the tutorial  [here](https://kubernetes.io/docs/tutorials/services/source-ip/#source-ip-for-services-with-type-nodeport) and your client will fail to connect.\r\n\r\n**Anything else we need to know?**:\r\nWhen kube-proxy starts we see the following warning in the log:\r\n`W1106 22:08:09.857720    5712 server.go:601] Failed to retrieve node info: nodes \"10.9.57.240\" not found\r\n\r\nW1106 22:08:09.857858    5712 proxier.go:306] invalid nodeIP, initializing kube-proxy with 127.0.0.1 as nodeIP`\r\n\r\nWe think there is something different/wrong with how kubelet registers the node. We see that CFCR passes \r\nkubelet the **--hostname-override=<IP>** to kubelet, for example:\r\n`kubelet --allow-privileged=false --cadvisor-port=0 --cloud-provider=vsphere --cni-bin-dir=/var/vcap/jobs/kubelet/packages/cni/bin --config=/var/vcap/jobs/kubelet/config/kubeletconfig.yml --container-runtime=docker --docker-endpoint=unix:///var/vcap/sys/run/docker/docker.sock --docker=unix:///var/vcap/sys/run/docker/docker.sock --fail-swap-on=false --hostname-override=10.9.57.240 --keep-terminated-pod-volumes=false --kubeconfig=/var/vcap/jobs/kubelet/config/kubeconfig --network-plugin=cni --node-labels=spec.ip=10.9.57.240,bosh.id=262bfb3b-a9c8-4e13-a94c-a7a50a26247f,failure-domain.beta.kubernetes.io/zone=z1 --v=2`\r\nHowever kubectl get nodes -o wide shows the node name hostname not the IP:\r\n`cd252906-4f17-488e-81b2-d2d21fbdc04f   Ready     <none>    26d       v1.10.3`\r\n\r\nThis explains why kube-proxy cannot find the node name with the IP.\r\n\r\n**Environment**:\r\n- Deployment Info (`bosh -d <deployment> deployment`):\r\nName  Release(s)      Stemcell(s)                                       Config(s)  Team(s)\r\ncfcr  bosh-dns/0.2.0  bosh-vsphere-esxi-ubuntu-trusty-go_agent/3586.16  -          -\r\n      bpm/0.6.0\r\n      cfcr-etcd/1.3\r\n      docker/32.0.0\r\n      kubo/0.17.0\r\n\r\n- Environment Info (`bosh -e <environment> environment`):\r\nName      bp-cfcr\r\nUUID      8f8aa31e-4f04-4f2d-b474-53a7782156e5\r\nVersion   264.7.0 (00000000)\r\nCPI       vsphere_cpi\r\nFeatures  compiled_package_cache: disabled\r\n          config_server: enabled\r\n          dns: disabled\r\n          snapshots: disabled\r\nUser      bosh_admin\r\n\r\n- Kubernetes version (`kubectl version`):\r\nClient Version: version.Info{Major:\"1\", Minor:\"10\", GitVersion:\"v1.10.3\", GitCommit:\"2bba0127d85d5a46ab4b778548be28623b32d0b0\", GitTreeState:\"clean\", BuildDate:\"2018-05-21T09:17:39Z\", GoVersion:\"go1.9.3\", Compiler:\"gc\", Platform:\"darwin/amd64\"}\r\nServer Version: version.Info{Major:\"1\", Minor:\"10\", GitVersion:\"v1.10.3\", GitCommit:\"2bba0127d85d5a46ab4b778548be28623b32d0b0\", GitTreeState:\"clean\", BuildDate:\"2018-05-21T09:05:37Z\", GoVersion:\"go1.9.3\", Compiler:\"gc\", Platform:\"linux/amd64\"}\r\n- Cloud provider (e.g. `aws`, `gcp`, `vsphere`):\r\nvsphere"},"comment":{"url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release/issues/comments/439173655","html_url":"https://github.com/cloudfoundry-incubator/kubo-release/issues/277#issuecomment-439173655","issue_url":"https://api.github.com/repos/cloudfoundry-incubator/kubo-release/issues/277","id":439173655,"node_id":"MDEyOklzc3VlQ29tbWVudDQzOTE3MzY1NQ==","user":{"login":"cf-gitbot","id":5589368,"node_id":"MDQ6VXNlcjU1ODkzNjg=","avatar_url":"https://avatars3.githubusercontent.com/u/5589368?v=4","gravatar_id":"","url":"https://api.github.com/users/cf-gitbot","html_url":"https://github.com/cf-gitbot","followers_url":"https://api.github.com/users/cf-gitbot/followers","following_url":"https://api.github.com/users/cf-gitbot/following{/other_user}","gists_url":"https://api.github.com/users/cf-gitbot/gists{/gist_id}","starred_url":"https://api.github.com/users/cf-gitbot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cf-gitbot/subscriptions","organizations_url":"https://api.github.com/users/cf-gitbot/orgs","repos_url":"https://api.github.com/users/cf-gitbot/repos","events_url":"https://api.github.com/users/cf-gitbot/events{/privacy}","received_events_url":"https://api.github.com/users/cf-gitbot/received_events","type":"User","site_admin":false},"created_at":"2018-11-15T20:09:12Z","updated_at":"2018-11-15T20:09:12Z","author_association":"NONE","body":"We have created an issue in Pivotal Tracker to manage this: \n\nhttps://www.pivotaltracker.com/story/show/161996693 \n\nThe labels on this github issue will be updated when the story is started."}}
{"actor":{"display_login":"cf-gitbot"}}