{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/20507","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/20507/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/20507/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/20507/events","html_url":"https://github.com/kubernetes/kubernetes/issues/20507","id":130778680,"number":20507,"title":"e2e failure: Restart [Disruptive] should restart all nodes and ensure all nodes and pods recover","user":{"login":"jlowdermilk","id":2101035,"avatar_url":"https://avatars.githubusercontent.com/u/2101035?v=3","gravatar_id":"","url":"https://api.github.com/users/jlowdermilk","html_url":"https://github.com/jlowdermilk","followers_url":"https://api.github.com/users/jlowdermilk/followers","following_url":"https://api.github.com/users/jlowdermilk/following{/other_user}","gists_url":"https://api.github.com/users/jlowdermilk/gists{/gist_id}","starred_url":"https://api.github.com/users/jlowdermilk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jlowdermilk/subscriptions","organizations_url":"https://api.github.com/users/jlowdermilk/orgs","repos_url":"https://api.github.com/users/jlowdermilk/repos","events_url":"https://api.github.com/users/jlowdermilk/events{/privacy}","received_events_url":"https://api.github.com/users/jlowdermilk/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P0","name":"priority/P0","color":"e11d21"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/cluster","name":"team/cluster","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"mwielgus","id":11994812,"avatar_url":"https://avatars.githubusercontent.com/u/11994812?v=3","gravatar_id":"","url":"https://api.github.com/users/mwielgus","html_url":"https://github.com/mwielgus","followers_url":"https://api.github.com/users/mwielgus/followers","following_url":"https://api.github.com/users/mwielgus/following{/other_user}","gists_url":"https://api.github.com/users/mwielgus/gists{/gist_id}","starred_url":"https://api.github.com/users/mwielgus/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mwielgus/subscriptions","organizations_url":"https://api.github.com/users/mwielgus/orgs","repos_url":"https://api.github.com/users/mwielgus/repos","events_url":"https://api.github.com/users/mwielgus/events{/privacy}","received_events_url":"https://api.github.com/users/mwielgus/received_events","type":"User","site_admin":false},"milestone":null,"comments":5,"created_at":"2016-02-02T18:49:32Z","updated_at":"2016-02-02T20:23:07Z","closed_at":null,"body":"The node restart test has been failing consistently past few runs: http://kubekins.dls.corp.google.com/view/Critical%20Builds/job/kubernetes-e2e-gce-serial/\r\n\r\nFrom test logs it looks like kube-system pods are not being rescheduled within 2m after the nodes come back. #19889 is a possible culprit; test was passing before that got merged.\r\n\r\nSample failure (from [kubernetes-e2e-gce-serial/368](http://kubekins.dls.corp.google.com/view/Critical%20Builds/job/kubernetes-e2e-gce-serial/368/) [gcs](https://storage.cloud.google.com/kubernetes-jenkins/logs/kubernetes-e2e-gce-serial/368)\r\n\r\n```\r\n09:20:13 Feb  2 09:20:13.210: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m44.693791979s elapsed)\r\n09:20:15 Feb  2 09:20:15.215: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m46.69873923s elapsed)\r\n09:20:17 Feb  2 09:20:17.220: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m48.703549212s elapsed)\r\n09:20:19 Feb  2 09:20:19.225: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m50.708551772s elapsed)\r\n09:20:21 Feb  2 09:20:21.230: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m52.713505396s elapsed)\r\n09:20:23 Feb  2 09:20:23.235: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m54.718077785s elapsed)\r\n09:20:25 Feb  2 09:20:25.239: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m56.722986874s elapsed)\r\n09:20:27 Feb  2 09:20:27.244: INFO: Waiting for pod heapster-v13-estsb in namespace 'kube-system' status to be 'running and ready'(found phase: \"Running\", readiness: false) (1m58.727483325s elapsed)\r\n09:20:29 Feb  2 09:20:29.270: INFO: Pod monitoring-influxdb-grafana-v3-3h8dv failed to be running and ready.\r\n09:20:29 Feb  2 09:20:29.270: INFO: Wanted all 15 pods to be running and ready. Result: false. Pods: [l7-lb-controller-du0fu elasticsearch-logging-v1-dzxhq fluentd-elasticsearch-e2e-serial-minion-eyee kube-dns-v10-d30c0 kube-ui-v5-wiit2 kube-proxy-e2e-serial-minion-eyee kibana-logging-v1-oqa94 heapster-v13-estsb fluentd-elasticsearch-e2e-serial-minion-d49u kibana-logging-v1-l72a1 kube-proxy-e2e-serial-minion-wpbj kube-proxy-e2e-serial-minion-d49u elasticsearch-logging-v1-4lzcy fluentd-elasticsearch-e2e-serial-minion-wpbj monitoring-influxdb-grafana-v3-3h8dv]\r\n09:20:29 [AfterEach] Restart [Disruptive]\r\n09:20:29   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/restart.go:76\r\n09:20:29 \r\n09:20:29 • Failure [123.205 seconds]\r\n```"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/178802485","html_url":"https://github.com/kubernetes/kubernetes/issues/20507#issuecomment-178802485","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/20507","id":178802485,"user":{"login":"dchen1107","id":7740897,"avatar_url":"https://avatars.githubusercontent.com/u/7740897?v=3","gravatar_id":"","url":"https://api.github.com/users/dchen1107","html_url":"https://github.com/dchen1107","followers_url":"https://api.github.com/users/dchen1107/followers","following_url":"https://api.github.com/users/dchen1107/following{/other_user}","gists_url":"https://api.github.com/users/dchen1107/gists{/gist_id}","starred_url":"https://api.github.com/users/dchen1107/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dchen1107/subscriptions","organizations_url":"https://api.github.com/users/dchen1107/orgs","repos_url":"https://api.github.com/users/dchen1107/repos","events_url":"https://api.github.com/users/dchen1107/events{/privacy}","received_events_url":"https://api.github.com/users/dchen1107/received_events","type":"User","site_admin":false},"created_at":"2016-02-02T20:23:06Z","updated_at":"2016-02-02T20:23:06Z","body":"@piosz & @mwielgus FYI. the problem is very easy to trigger by reboot."}}