{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/24865","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/24865/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/24865/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/24865/events","html_url":"https://github.com/kubernetes/kubernetes/issues/24865","id":151400253,"number":24865,"title":"All nodes in specific GCE zone register then immediately disappear","user":{"login":"cmoad","id":581272,"avatar_url":"https://avatars0.githubusercontent.com/u/581272?v=4","gravatar_id":"","url":"https://api.github.com/users/cmoad","html_url":"https://github.com/cmoad","followers_url":"https://api.github.com/users/cmoad/followers","following_url":"https://api.github.com/users/cmoad/following{/other_user}","gists_url":"https://api.github.com/users/cmoad/gists{/gist_id}","starred_url":"https://api.github.com/users/cmoad/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cmoad/subscriptions","organizations_url":"https://api.github.com/users/cmoad/orgs","repos_url":"https://api.github.com/users/cmoad/repos","events_url":"https://api.github.com/users/cmoad/events{/privacy}","received_events_url":"https://api.github.com/users/cmoad/received_events","type":"User","site_admin":false},"labels":[{"id":116801185,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/kind/documentation","name":"kind/documentation","color":"c7def8","default":false},{"id":778118402,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/lifecycle/rotten","name":"lifecycle/rotten","color":"604460","default":false},{"id":114528273,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/backlog","name":"priority/backlog","color":"fbca04","default":false},{"id":173494222,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/sig/cluster-lifecycle","name":"sig/cluster-lifecycle","color":"d2b48c","default":false},{"id":244613097,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/control-plane%20(deprecated%20-%20do%20not%20use)","name":"team/control-plane (deprecated - do not use)","color":"ededed","default":false},{"id":243794453,"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/ux%20(deprecated%20-%20do%20not%20use)","name":"team/ux (deprecated - do not use)","color":"ededed","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2016-04-27T14:28:45Z","updated_at":"2018-02-25T22:40:49Z","closed_at":null,"author_association":"NONE","body":"We have a fresh v1.2.3 cluster in an HA configuration. Masters are in us-east1-[b,c,d]. All the worker nodes in us-east1-b come up and work fine. However, all nodes in us-east1-[c,d] appear to register fine with the kubelet, but then immediately disappear. The logs show that these nodes successfully register but they appear to immediately re-register.\n\nHere are the logs we are seeing which go into a fail loop you can see at the bottom.\n\n```\n-- Logs begin at Wed 2016-04-27 13:50:05 UTC, end at Wed 2016-04-27 13:53:31 UTC. --\nApr 27 13:51:23 k8s-node-frontend02.c.geofeedia-qa1.internal systemd[1]: Starting Kubernetes worker kubelet...\nApr 27 13:51:23 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: --2016-04-27 13:51:23--  https://storage.googleapis.com/kubernetes-release/release/v1.2.3/bin/linux/amd64/kubelet\nApr 27 13:51:23 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: Resolving storage.googleapis.com... 74.125.141.128, 2607:f8b0:400c:c06::80\nApr 27 13:51:23 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: Connecting to storage.googleapis.com|74.125.141.128|:443... connected.\nApr 27 13:51:24 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: HTTP request sent, awaiting response... 200 OK\nApr 27 13:51:24 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: Length: 63204456 (60M) [application/octet-stream]\nApr 27 13:51:24 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: Saving to: '/opt/bin/kubelet'\nApr 27 13:51:31 k8s-node-frontend02.c.geofeedia-qa1.internal systemd[1]: Started Kubernetes worker kubelet.\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.389951    2419 gce.go:269] Using existing Token Source &oauth2.reuseTokenSource{new:google.computeSource{account:\"\"}, mu:sync.Mutex{state:0, sema:0x0}, t:(*oauth2.Token)(nil)}\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.397949    2419 manager.go:132] cAdvisor running in container: \"/system.slice/k8s-kubelet-node.service\"\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.597618    2419 fs.go:109] Filesystem partitions: map[/dev/sda9:{mountpoint:/ major:8 minor:9 fsType: blockSize:0} /dev/sda3:{mountpoint:/usr major:8 minor:3 fsType: blockSize:0} /dev/sda6:{mountpoint:/usr/share/oem major:8 minor:6 fsType: blockSize:0}]\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.604844    2419 manager.go:169] Machine: {NumCores:2 CpuFrequency:2300000 MemoryCapacity:7848390656 MachineID:73bf9d4ee4e7bf171b4b310e33bfaec5 SystemUUID:73BF9D4E-E4E7-BF17-1B4B-310E33BFAEC5 BootID:63d89deb-8ab0-4479-a884-7a4202f2bde8 Filesystems:[{Device:/dev/sda3 Capacity:1031946240 Type:vfs Inodes:260096} {Device:/dev/sda6 Capacity:113229824 Type:vfs Inodes:32768} {Device:/dev/sda9 Capacity:49536561152 Type:vfs Inodes:12444032}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:53687091200 Scheduler:cfq}] NetworkDevices:[{Name:ens4v1 MacAddress:42:01:0a:f0:00:1b Speed:0 Mtu:1460} {Name:flannel.1 MacAddress:ce:d1:6b:7c:d4:f4 Speed:0 Mtu:1410}] Topology:[{Id:0 Memory:7848390656 Cores:[{Id:0 Threads:[0 1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:47185920 Type:Unified Level:3}]}] CloudProvider:GCE InstanceType:n1-standard-2 InstanceID:6859253449092857240}\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.605729    2419 manager.go:175] Version: {KernelVersion:4.3.6-coreos ContainerOsVersion:CoreOS 899.15.0 DockerVersion:1.9.1 CadvisorVersion: CadvisorRevision:}\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.606557    2419 server.go:673] Adding manifest file: /etc/kubernetes/manifests\nApr 27 13:51:32 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.606585    2419 server.go:683] Watching apiserver\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: W0427 13:51:32.616305    2419 kubelet.go:508] Hairpin mode set to \"promiscuous-bridge\" but configureCBR0 is false, falling back to \"hairpin-veth\"\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.616336    2419 kubelet.go:380] Hairpin mode set to \"hairpin-veth\"\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.780091    2419 manager.go:212] Setting dockerRoot to /var/lib/docker\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.780114    2419 plugins.go:56] Registering credential provider: .dockercfg\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.781711    2419 plugins.go:56] Registering credential provider: google-dockercfg\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.782126    2419 plugins.go:56] Registering credential provider: google-dockercfg-url\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.782602    2419 plugins.go:56] Registering credential provider: google-container-registry\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.783182    2419 server.go:645] Started kubelet\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.783296    2419 server.go:109] Starting to listen on 0.0.0.0:10250\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:32.784768    2419 kubelet.go:956] Image garbage collection failed: unable to find data for container /\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.787014    2419 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.787033    2419 manager.go:123] Starting to sync pod status with apiserver\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.787047    2419 kubelet.go:2356] Starting kubelet main sync loop.\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.787081    2419 kubelet.go:2365] skipping pod synchronization - [container runtime is down]\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.890831    2419 kubelet.go:1086] Adding node label from cloud provider: beta.kubernetes.io/instance-type=n1-standard-2\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.890859    2419 kubelet.go:1097] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/zone=us-east1-c\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.890867    2419 kubelet.go:1101] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=us-east1\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:32.963377    2419 kubelet.go:1165] Successfully registered node k8s-node-frontend02\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:33.026945    2419 factory.go:233] Registering Docker factory\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:33.027970    2419 factory.go:97] Registering Raw factory\nApr 27 13:51:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:33.149832    2419 manager.go:1003] Started watching for new ooms in manager\nApr 27 13:51:34 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:33.150628    2419 oomparser.go:182] oomparser using systemd\nApr 27 13:51:34 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:33.151328    2419 manager.go:256] Starting recovery of all containers\nApr 27 13:51:34 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: W0427 13:51:33.268406    2419 container.go:341] Failed to create summary reader for \"/system.slice/system-systemd\\\\x2dfsck.slice\": none of the resources are being tracked.\nApr 27 13:51:34 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: W0427 13:51:33.268579    2419 container.go:341] Failed to create summary reader for \"/system.slice/systemd-fsck-root.service\": none of the resources are being tracked.\nApr 27 13:51:34 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:33.330031    2419 manager.go:261] Recovery completed\nApr 27 13:51:34 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: W0427 13:51:34.028035    2419 handler.go:562] Error while processing event (\"/sys/fs/cgroup/memory/system.slice/google-startup-scripts-onboot.service\": 0x40000100 == IN_CREATE|IN_ISDIR): open /sys/fs/cgroup/memory/system.slice/google-startup-scripts-onboot.service: no such file or directory\nApr 27 13:51:36 k8s-node-frontend02.c.geofeedia-qa1.internal wget[2411]: 2016-04-27 13:51:31 (7.94 MB/s) - '/opt/bin/kubelet' saved [63204456/63204456]\nApr 27 13:51:37 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:37.787338    2419 kubelet.go:2307] error getting node: node 'k8s-node-frontend02' is not in cache\nApr 27 13:51:37 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:37.805531    2419 provider.go:91] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider\nApr 27 13:51:37 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:37.805690    2419 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider\nApr 27 13:51:37 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:37.806255    2419 metadata.go:112] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg\nApr 27 13:51:37 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: I0427 13:51:37.806288    2419 provider.go:91] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider\nApr 27 13:51:37 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:37.808140    2419 metadata.go:124] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url\nApr 27 13:51:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:43.051937    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:43.053962    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:43.056111    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:43.058045    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:43.059951    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:43.059974    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:51:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:53.063171    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:53.065661    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:53.067878    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:53.070312    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:53.072629    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:51:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:53.072973    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:51:57 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:57.167157    2419 manager.go:2142] Unable to inspect container \"92e31e0538366113a635ffe41f7e6d13002143e561f6c92a525b143131e00b2d\": No such container: 92e31e0538366113a635ffe41f7e6d13002143e561f6c92a525b143131e00b2d\nApr 27 13:51:58 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:58.175553    2419 kubelet.go:1753] Deleting mirror pod \"kube-proxy-k8s-node-frontend02_kube-system(2982d110-0c7f-11e6-9646-42010af00011)\" because it is outdated\nApr 27 13:51:59 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:51:59.188811    2419 kubelet.go:1764] Failed creating a mirror pod for \"kube-proxy-k8s-node-frontend02_kube-system(6083ce4c9a53c046497efe1a2016bc98)\": pods \"kube-proxy-k8s-node-frontend02\" already exists\nApr 27 13:52:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:03.075980    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:03.078162    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:03.080114    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:03.082075    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:03.083955    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:03.083975    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:52:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:13.087771    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:13.089687    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:13.091532    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:13.093609    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:13.095561    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:13.095578    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:52:14 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:14.099410    2419 kubelet.go:1753] Deleting mirror pod \"kube-proxy-k8s-node-frontend02_kube-system(35ab2144-0c7f-11e6-9646-42010af00011)\" because it is outdated\nApr 27 13:52:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:23.098751    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:23.100961    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:23.103064    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:23.105066    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:23.107012    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:23.107026    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:52:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:33.110975    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:33.113164    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:33.117205    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:33.119596    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:33.121681    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:33 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:33.121907    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:52:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:43.135107    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:43.137476    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:43.139530    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:43.141408    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:43.143529    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:43 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:43.143546    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:52:44 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:44.137711    2419 kubelet.go:1753] Deleting mirror pod \"kube-proxy-k8s-node-frontend02_kube-system(3f2aa456-0c7f-11e6-9646-42010af00011)\" because it is outdated\nApr 27 13:52:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:53.146869    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:53.149270    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:53.151425    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:53.153497    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:53.155241    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:52:53 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:52:53.155256    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:53:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:03.158867    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:03.160778    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:03.162675    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:03.164527    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:03.166426    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:03 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:03.166441    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:53:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:13.170017    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:13.172148    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:13.174121    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:13.176253    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:13.178313    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:13 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:13.178330    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\nApr 27 13:53:14 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:14.157389    2419 kubelet.go:1753] Deleting mirror pod \"kube-proxy-k8s-node-frontend02_kube-system(51149c00-0c7f-11e6-9646-42010af00011)\" because it is outdated\nApr 27 13:53:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:23.182309    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:23.184271    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:23.186079    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:23.188134    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:23.189984    2419 kubelet.go:2745] Error updating node status, will retry: error getting node \"k8s-node-frontend02\": nodes \"k8s-node-frontend02\" not found\nApr 27 13:53:23 k8s-node-frontend02.c.geofeedia-qa1.internal bash[2419]: E0427 13:53:23.190000    2419 kubelet.go:1183] Unable to update node status: update node status exceeds retry count\n```\n"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/368352039","html_url":"https://github.com/kubernetes/kubernetes/issues/24865#issuecomment-368352039","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/24865","id":368352039,"user":{"login":"fejta-bot","id":30488982,"avatar_url":"https://avatars1.githubusercontent.com/u/30488982?v=4","gravatar_id":"","url":"https://api.github.com/users/fejta-bot","html_url":"https://github.com/fejta-bot","followers_url":"https://api.github.com/users/fejta-bot/followers","following_url":"https://api.github.com/users/fejta-bot/following{/other_user}","gists_url":"https://api.github.com/users/fejta-bot/gists{/gist_id}","starred_url":"https://api.github.com/users/fejta-bot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fejta-bot/subscriptions","organizations_url":"https://api.github.com/users/fejta-bot/orgs","repos_url":"https://api.github.com/users/fejta-bot/repos","events_url":"https://api.github.com/users/fejta-bot/events{/privacy}","received_events_url":"https://api.github.com/users/fejta-bot/received_events","type":"User","site_admin":false},"created_at":"2018-02-25T22:40:49Z","updated_at":"2018-02-25T22:40:49Z","author_association":"NONE","body":"Rotten issues close after 30d of inactivity.\nReopen the issue with `/reopen`.\nMark the issue as fresh with `/remove-lifecycle rotten`.\n\nSend feedback to sig-testing, kubernetes/test-infra and/or [fejta](https://github.com/fejta).\n/close"}}
{"actor":{"display_login":"fejta-bot"}}