{"action":"opened","issue":{"url":"https://api.github.com/repos/rancher/rancher/issues/15048","repository_url":"https://api.github.com/repos/rancher/rancher","labels_url":"https://api.github.com/repos/rancher/rancher/issues/15048/labels{/name}","comments_url":"https://api.github.com/repos/rancher/rancher/issues/15048/comments","events_url":"https://api.github.com/repos/rancher/rancher/issues/15048/events","html_url":"https://github.com/rancher/rancher/issues/15048","id":349752670,"node_id":"MDU6SXNzdWUzNDk3NTI2NzA=","number":15048,"title":"Rancher fails to synchronize state","user":{"login":"tboemker-bkfs","id":26487373,"node_id":"MDQ6VXNlcjI2NDg3Mzcz","avatar_url":"https://avatars2.githubusercontent.com/u/26487373?v=4","gravatar_id":"","url":"https://api.github.com/users/tboemker-bkfs","html_url":"https://github.com/tboemker-bkfs","followers_url":"https://api.github.com/users/tboemker-bkfs/followers","following_url":"https://api.github.com/users/tboemker-bkfs/following{/other_user}","gists_url":"https://api.github.com/users/tboemker-bkfs/gists{/gist_id}","starred_url":"https://api.github.com/users/tboemker-bkfs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tboemker-bkfs/subscriptions","organizations_url":"https://api.github.com/users/tboemker-bkfs/orgs","repos_url":"https://api.github.com/users/tboemker-bkfs/repos","events_url":"https://api.github.com/users/tboemker-bkfs/events{/privacy}","received_events_url":"https://api.github.com/users/tboemker-bkfs/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-11T18:02:23Z","updated_at":"2018-08-11T18:02:23Z","closed_at":null,"author_association":"NONE","body":"kubectl delete fails:\r\nerror: error when stopping \"kube/redis-sentinel.yml\": timed out waiting for \"redis-sentinel\" to be synced\r\nerror: error when stopping \"kube/activemq.yml\": timed out waiting for \"activemq\" to be synced\r\nerror: error when stopping \"kube/filebeat.yml\": timed out waiting for the condition\r\n\r\nkubelet log shows errors:\r\nI0811 17:35:54.807328    1915 kubelet.go:1877] SyncLoop (DELETE, \"api\"): \"filebeat-fwwv8_default(f16110c1-9c07-11e8-8770-005056813bfa)\"\r\nI0811 17:35:59.806624    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:35:59.806665    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:35:59.806643    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:08.908480    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:08.908535    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:08.908566    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:13.910913    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:13.911000    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:13.910921    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:18.912368    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:18.912396    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:18.912416    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:23.914248    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:23.914290    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:23.914305    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:28.915324    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:28.915485    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:28.915625    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nE0811 17:36:31.309503    1915 remote_runtime.go:115] StopPodSandbox \"b204663372da1435068cdac3cd4c7b31af6f87b861672404d74e18992a8a265b\" from runtime service failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded\r\nE0811 17:36:31.309602    1915 kuberuntime_gc.go:153] Failed to stop sandbox \"b204663372da1435068cdac3cd4c7b31af6f87b861672404d74e18992a8a265b\" before removing: rpc error: code = DeadlineExceeded desc = context deadline exceeded\r\nI0811 17:36:33.917930    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:33.917991    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:33.918001    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:38.920052    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:38.920080    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:38.920097    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:43.922236    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:43.922258    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:43.922227    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:48.923494    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:48.923532    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:48.923646    1915 streamwatcher.go:103] Unexpected EOF during watch stream event decoding: unexpected EOF\r\nI0811 17:36:49.651387    1915 kubelet.go:1799] skipping pod synchronization - [PLEG is not healthy: pleg was last seen active 3m0.478788061s ago; threshold is 3m0s]\r\nI0811 17:36:49.751565    1915 kubelet.go:1799] skipping pod synchronization - [PLEG is not healthy: pleg was last seen active 3m0.578961464s ago; threshold is 3m0s]\r\nI0811 17:36:49.951726    1915 kubelet.go:1799] skipping pod synchronization - [PLEG is not healthy: pleg was last seen active 3m0.779120077s ago; threshold is 3m0s]\r\nI0811 17:36:50.351898    1915 kubelet.go:1799] skipping pod synchronization - [PLEG is not healthy: pleg was last seen active 3m1.179294488s ago; threshold is 3m0s]\r\nI0811 17:36:51.152132    1915 kubelet.go:1799] skipping pod synchronization - [PLEG is not healthy: pleg was last seen active 3m1.979515226s ago; threshold is 3m0s]\r\nI0811 17:36:52.752373    1915 kubelet.go:1799] skipping pod synchronization - [PLEG is not healthy: pleg was last seen active 3m3.5797569s ago; threshold is 3m0s]\r\n\r\n\r\n\r\n---\r\n| Useful | Info |\r\n| :-- | :-- |\r\n|Versions|Rancher `v2.0.6` UI: `v2.0.61` |\r\n|Access|`local` `admin`|\r\n|Route|`containers.index`|\r\n"}}
{"actor":{"display_login":"tboemker-bkfs"}}