{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/21921","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/21921/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/21921/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/21921/events","html_url":"https://github.com/kubernetes/kubernetes/issues/21921","id":136206958,"number":21921,"title":"e2e flake: pods should have their auto-restart back-off timer reset on image update [Slow]","user":{"login":"a-robinson","id":7085343,"avatar_url":"https://avatars.githubusercontent.com/u/7085343?v=3","gravatar_id":"","url":"https://api.github.com/users/a-robinson","html_url":"https://github.com/a-robinson","followers_url":"https://api.github.com/users/a-robinson/followers","following_url":"https://api.github.com/users/a-robinson/following{/other_user}","gists_url":"https://api.github.com/users/a-robinson/gists{/gist_id}","starred_url":"https://api.github.com/users/a-robinson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/a-robinson/subscriptions","organizations_url":"https://api.github.com/users/a-robinson/orgs","repos_url":"https://api.github.com/users/a-robinson/repos","events_url":"https://api.github.com/users/a-robinson/events{/privacy}","received_events_url":"https://api.github.com/users/a-robinson/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/kind/flake","name":"kind/flake","color":"f7c6c7"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P1","name":"priority/P1","color":"eb6420"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/node","name":"team/node","color":"d2b48c"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-02-24T22:29:21Z","updated_at":"2016-02-25T00:16:59Z","closed_at":null,"body":"/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/pods.go:983 Feb 24 13:38:26.304: updating image did not reset the back-off value in pod=pod-back-off-image/back-off d3=5m22s d2=1m33s d1=2m49s\r\n\r\nBuild log at https://cloud.google.com/console/storage/kubernetes-jenkins/logs/kubernetes-e2e-gce-slow/2565/"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/188530101","html_url":"https://github.com/kubernetes/kubernetes/issues/21921#issuecomment-188530101","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/21921","id":188530101,"user":{"login":"yujuhong","id":10524058,"avatar_url":"https://avatars.githubusercontent.com/u/10524058?v=3","gravatar_id":"","url":"https://api.github.com/users/yujuhong","html_url":"https://github.com/yujuhong","followers_url":"https://api.github.com/users/yujuhong/followers","following_url":"https://api.github.com/users/yujuhong/following{/other_user}","gists_url":"https://api.github.com/users/yujuhong/gists{/gist_id}","starred_url":"https://api.github.com/users/yujuhong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yujuhong/subscriptions","organizations_url":"https://api.github.com/users/yujuhong/orgs","repos_url":"https://api.github.com/users/yujuhong/repos","events_url":"https://api.github.com/users/yujuhong/events{/privacy}","received_events_url":"https://api.github.com/users/yujuhong/received_events","type":"User","site_admin":false},"created_at":"2016-02-25T00:16:59Z","updated_at":"2016-02-25T00:16:59Z","body":"```\r\nSTEP: Collecting events from namespace \"e2e-tests-pods-zwa52\".\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:31 -0800 PST - event for pod-back-off-image: {default-scheduler } Scheduled: Successfully assigned pod-back-off-image to jenkins-e2e-minion-sdss\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:31 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Pulling: pulling image \"gcr.io/google_containers/busybox:1.24\"\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:32 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id 0e6f2eae3e7f\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:32 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id 0e6f2eae3e7f\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:32 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Pulled: Successfully pulled image \"gcr.io/google_containers/busybox:1.24\"\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:37 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Pulled: Container image \"gcr.io/google_containers/busybox:1.24\" already present on machine\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:37 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id d63b1be0102c\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:38 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id d63b1be0102c\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:43 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} BackOff: Back-off restarting failed docker container\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:43 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with CrashLoopBackOff: \"Back-off 10s restarting failed container=back-off pod=pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:57 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id 1adb60a513f5\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:26:57 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id 1adb60a513f5\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:27:02 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with CrashLoopBackOff: \"Back-off 20s restarting failed container=back-off pod=pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:27:28 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id f35e597302b6\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:27:28 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id f35e597302b6\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:27:34 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with CrashLoopBackOff: \"Back-off 40s restarting failed container=back-off pod=pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:28:26 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id f9306759c3d1\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:28:26 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id f9306759c3d1\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:28:31 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with CrashLoopBackOff: \"Back-off 1m20s restarting failed container=back-off pod=pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:30:04 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id c118aa60c9ec\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:30:04 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id c118aa60c9ec\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:30:10 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with CrashLoopBackOff: \"Back-off 2m40s restarting failed container=back-off pod=pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:32:58 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id 83516116540d\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:32:58 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id 83516116540d\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:33:03 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Killing: Killing container with docker id 83516116540d: pod \"pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\" container \"back-off\" hash changed (1380524049 vs 645862520), it will be killed and re-created.\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:33:03 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Pulling: pulling image \"nginx\"\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:34:03 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Failed: Failed to pull image \"nginx\": Network timed out while trying to connect to https://index.docker.io/v1/repositories/library/nginx/images. You may want to check your internet connection or if you are behind a proxy.\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:34:03 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with ErrImagePull: \"Network timed out while trying to connect to https://index.docker.io/v1/repositories/library/nginx/images. You may want to check your internet connection or if you are behind a proxy.\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:34:03 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} BackOff: Back-off pulling image \"nginx\"\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:34:03 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with ImagePullBackOff: \"Back-off pulling image \\\"nginx\\\"\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:37:23 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} FailedSync: Error syncing pod, skipping: failed to \"StartContainer\" for \"back-off\" with CrashLoopBackOff: \"Back-off 5m0s restarting failed container=back-off pod=pod-back-off-image_e2e-tests-pods-zwa52(45934fc0-db3d-11e5-9c8a-42010af00002)\"\r\n\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:38:25 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Pulled: Successfully pulled image \"nginx\"\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:38:25 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Created: Created container with docker id e65e2457467f\r\nFeb 24 13:38:26.320: INFO: At 2016-02-24 13:38:25 -0800 PST - event for pod-back-off-image: {kubelet jenkins-e2e-minion-sdss} Started: Started container with docker id e65e2457467f\r\n```\r\n\r\n`Failed: Failed to pull image \"nginx\": Network timed out while trying to connect to https://index.docker.io/v1/repositories/library/nginx/images. You may want to check your internet connection or if you are behind a proxy.` Looks like the image pulling failed, causing the extra delay (backoff). The test should use a versioned nginx image to avoid unnecessary pulling (#21610)\r\n\r\n/cc @freehan @ArtfulCoder , who was looking at the image pulling failures previously, even though this one may be unrelated."}}