{"action":"opened","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/26436","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/26436/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/26436/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/26436/events","html_url":"https://github.com/kubernetes/kubernetes/issues/26436","id":157245633,"number":26436,"title":"kubernetes-e2e-gce-federation is failing consistently with 'projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-http-alt' was not found","user":{"login":"quinton-hoole","id":10390785,"avatar_url":"https://avatars.githubusercontent.com/u/10390785?v=3","gravatar_id":"","url":"https://api.github.com/users/quinton-hoole","html_url":"https://github.com/quinton-hoole","followers_url":"https://api.github.com/users/quinton-hoole/followers","following_url":"https://api.github.com/users/quinton-hoole/following{/other_user}","gists_url":"https://api.github.com/users/quinton-hoole/gists{/gist_id}","starred_url":"https://api.github.com/users/quinton-hoole/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/quinton-hoole/subscriptions","organizations_url":"https://api.github.com/users/quinton-hoole/orgs","repos_url":"https://api.github.com/users/quinton-hoole/repos","events_url":"https://api.github.com/users/quinton-hoole/events{/privacy}","received_events_url":"https://api.github.com/users/quinton-hoole/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/cluster-federation","name":"area/cluster-federation","color":"fad8c7"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P1","name":"priority/P1","color":"eb6420"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/control-plane","name":"team/control-plane","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"nikhiljindal","id":10199099,"avatar_url":"https://avatars.githubusercontent.com/u/10199099?v=3","gravatar_id":"","url":"https://api.github.com/users/nikhiljindal","html_url":"https://github.com/nikhiljindal","followers_url":"https://api.github.com/users/nikhiljindal/followers","following_url":"https://api.github.com/users/nikhiljindal/following{/other_user}","gists_url":"https://api.github.com/users/nikhiljindal/gists{/gist_id}","starred_url":"https://api.github.com/users/nikhiljindal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nikhiljindal/subscriptions","organizations_url":"https://api.github.com/users/nikhiljindal/orgs","repos_url":"https://api.github.com/users/nikhiljindal/repos","events_url":"https://api.github.com/users/nikhiljindal/events{/privacy}","received_events_url":"https://api.github.com/users/nikhiljindal/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/kubernetes/kubernetes/milestones/18","html_url":"https://github.com/kubernetes/kubernetes/milestones/v1.3","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/milestones/18/labels","id":1638460,"number":18,"title":"v1.3","description":"https://github.com/kubernetes/kubernetes/wiki/Release-1.3","creator":{"login":"bgrant0607","id":7725777,"avatar_url":"https://avatars.githubusercontent.com/u/7725777?v=3","gravatar_id":"","url":"https://api.github.com/users/bgrant0607","html_url":"https://github.com/bgrant0607","followers_url":"https://api.github.com/users/bgrant0607/followers","following_url":"https://api.github.com/users/bgrant0607/following{/other_user}","gists_url":"https://api.github.com/users/bgrant0607/gists{/gist_id}","starred_url":"https://api.github.com/users/bgrant0607/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bgrant0607/subscriptions","organizations_url":"https://api.github.com/users/bgrant0607/orgs","repos_url":"https://api.github.com/users/bgrant0607/repos","events_url":"https://api.github.com/users/bgrant0607/events{/privacy}","received_events_url":"https://api.github.com/users/bgrant0607/received_events","type":"User","site_admin":false},"open_issues":194,"closed_issues":256,"state":"open","created_at":"2016-03-11T07:40:20Z","updated_at":"2016-05-27T16:37:19Z","due_on":"2016-06-24T07:00:00Z","closed_at":null},"comments":0,"created_at":"2016-05-27T16:37:19Z","updated_at":"2016-05-27T16:37:19Z","closed_at":null,"body":"Just to make sure that this is getting attention.  Pretty sure that @colhom is busy fixing this, but I could not find the tracking issue.  Feel free to assign this back to me if necessary.\r\n\r\n```\r\nkubernetes-e2e-gce-federation - Build # 27 - Still Failing\r\nhttp://goto.google.com/k8s-test/job/kubernetes-e2e-gce-federation/27/\r\nStarted by timer\r\n\r\nChanges:\r\nNo changes\r\n\r\nFailed tests:\r\nNo tests ran.\r\n\r\nBuild log:\r\nhttps://storage.cloud.google.com/kubernetes-jenkins/logs/kubernetes-e2e-gce-federation/27/build-log.txt\r\n[...truncated 864 lines...]\r\njenkins-us-central1-f-minion-group-a60c   Ready                      29s\r\njenkins-us-central1-f-minion-group-ha2q   Ready                      25s\r\njenkins-us-central1-f-minion-group-zvjf   Ready                      29s\r\nValidate output:\r\nNAME                 STATUS    MESSAGE              ERROR\r\ncontroller-manager   Healthy   ok\r\nscheduler            Healthy   ok\r\netcd-1               Healthy   {\"health\": \"true\"}\r\netcd-0               Healthy   {\"health\": \"true\"}\r\nCluster validation succeeded\r\nDone, listing cluster services:\r\n\r\nKubernetes master is running at https://130.211.123.112\r\nGLBCDefaultBackend is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/default-http-backend\r\nElasticsearch is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/elasticsearch-logging\r\nHeapster is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/heapster\r\nKibana is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/kibana-logging\r\nKubeDNS is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/kube-dns\r\nkubernetes-dashboard is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/kubernetes-dashboard\r\nGrafana is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/monitoring-grafana\r\nInfluxDB is running at https://130.211.123.112/api/v1/proxy/namespaces/kube-system/services/monitoring-influxdb\r\n\r\nTo further debug and diagnose cluster problems, use 'kubectl cluster-info dump'.\r\n\r\nallowed:\r\n- IPProtocol: tcp\r\n  ports:\r\n  - '80'\r\n- IPProtocol: tcp\r\n  ports:\r\n  - '8080'\r\ncreationTimestamp: '2016-05-27T09:00:44.435-07:00'\r\ndescription: ''\r\nid: '7095430114407993795'\r\nkind: compute#firewall\r\nname: jenkins-e2e-minion-jenkins-e2e-http-alt\r\nnetwork: https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/networks/jenkins-e2e\r\nselfLink: https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-http-alt\r\nsourceRanges:\r\n- 0.0.0.0/0\r\ntargetTags:\r\n- jenkins-e2e-minion\r\nallowed:\r\n- IPProtocol: tcp\r\n  ports:\r\n  - 30000-32767\r\n- IPProtocol: udp\r\n  ports:\r\n  - 30000-32767\r\ncreationTimestamp: '2016-05-27T09:01:22.072-07:00'\r\ndescription: ''\r\nid: '7611402338315915709'\r\nkind: compute#firewall\r\nname: jenkins-e2e-minion-jenkins-e2e-nodeports\r\nnetwork: https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/networks/jenkins-e2e\r\nselfLink: https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-nodeports\r\nsourceRanges:\r\n- 0.0.0.0/0\r\ntargetTags:\r\n- jenkins-e2e-minion\r\ncat: /workspace/kubernetes/cluster/../_output/release-stage/server/linux-amd64/kubernetes/server/bin/federation-apiserver.docker_tag: No such file or directory\r\nnamespace \"federation-e2e\" created\r\nNo resources found\r\nservice \"federation-apiserver\" created\r\nattempting to get federation-apiserver loadbalancer hostname (1 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (2 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (3 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (4 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (5 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (6 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (7 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (8 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (9 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (10 / 30)\r\nattempting to get federation-apiserver loadbalancer hostname (11 / 30)\r\nFound federation-apiserver host at 104.197.149.66\r\nyaml: line 17: mapping values are not allowed in this context\r\n2016/05/27 09:11:00 e2e.go:218: Error running up: exit status 1\r\n2016/05/27 09:11:00 e2e.go:214: Step 'up' finished in 14m43.86767367s\r\n2016/05/27 09:11:00 e2e.go:114: Error starting e2e cluster. Aborting.\r\nexit status 1\r\n+ dump_cluster_logs_and_exit\r\n+ local -r exit_status=1\r\n+ [[ -x cluster/log-dump.sh ]]\r\n+ ./cluster/log-dump.sh /workspace/_artifacts\r\nDumping master and node logs to /workspace/_artifacts\r\nMaster not detected. Is the cluster up?\r\nNodes not detected. Is the cluster up?\r\n+ [[ true == \\t\\r\\u\\e ]]\r\n+ go run ./hack/e2e.go -v --down\r\n2016/05/27 09:11:02 e2e.go:212: Running: teardown\r\nProject: k8s-jkns-e2e-gce-federation\r\nZone: us-central1-f\r\nSetting zone vars to: federation-e2e-gce-us-central1-a\r\nservice \"federation-apiserver\" deleted\r\nShutting down test cluster in background.\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-http-alt].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-nodeports].\r\nBringing down cluster using provider: gce\r\n\r\nAll components are up to date.\r\n\r\nAll components are up to date.\r\n\r\nAll components are up to date.\r\nProject: k8s-jkns-e2e-gce-federation\r\nZone: us-central1-a\r\nINSTANCE_GROUPS=jenkins-us-central1-a-minion-group\r\nNODE_NAMES=jenkins-us-central1-a-minion-group-sk2z jenkins-us-central1-a-minion-group-x2r6 jenkins-us-central1-a-minion-group-yajf\r\nBringing down cluster\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-a/instanceGroupManagers/jenkins-us-central1-a-minion-group].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/instanceTemplates/jenkins-us-central1-a-minion-template].\r\nUpdated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-a/instances/jenkins-us-central1-a-master].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-a/instances/jenkins-us-central1-a-master].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-us-central1-a-master-https].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-us-central1-a-minion-all].\r\nDeleting routes jenkins-us-central1-a-04a3641a-2424-11e6-862d-42010af00002 jenkins-us-central1-a-0786a412-2424-11e6-862d-42010af00002\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/routes/jenkins-us-central1-a-0786a412-2424-11e6-862d-42010af00002].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/routes/jenkins-us-central1-a-04a3641a-2424-11e6-862d-42010af00002].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/regions/us-central1/addresses/jenkins-us-central1-a-master-ip].\r\nproperty \"clusters.k8s-jkns-e2e-gce-federation_jenkins-us-central1-a\" unset.\r\nproperty \"users.k8s-jkns-e2e-gce-federation_jenkins-us-central1-a\" unset.\r\nproperty \"users.k8s-jkns-e2e-gce-federation_jenkins-us-central1-a-basic-auth\" unset.\r\nproperty \"contexts.k8s-jkns-e2e-gce-federation_jenkins-us-central1-a\" unset.\r\nCleared config for k8s-jkns-e2e-gce-federation_jenkins-us-central1-a from /workspace/.kube/config\r\nDone\r\nSetting zone vars to: federation-e2e-gce-us-central1-b\r\nNo resources found\r\nShutting down test cluster in background.\r\nERROR: (gcloud.compute.firewall-rules.delete) Some requests did not succeed:\r\n - The resource 'projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-http-alt' was not found\r\n\r\nERROR: (gcloud.compute.firewall-rules.delete) Some requests did not succeed:\r\n - The resource 'projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-nodeports' was not found\r\n\r\nBringing down cluster using provider: gce\r\n\r\nAll components are up to date.\r\n\r\nAll components are up to date.\r\n\r\nAll components are up to date.\r\nProject: k8s-jkns-e2e-gce-federation\r\nZone: us-central1-b\r\nINSTANCE_GROUPS=jenkins-us-central1-b-minion-group\r\nNODE_NAMES=jenkins-us-central1-b-minion-group-2xsy jenkins-us-central1-b-minion-group-m5p2 jenkins-us-central1-b-minion-group-qqy0\r\nBringing down cluster\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-b/instanceGroupManagers/jenkins-us-central1-b-minion-group].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/instanceTemplates/jenkins-us-central1-b-minion-template].\r\nUpdated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-b/instances/jenkins-us-central1-b-master].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-b/instances/jenkins-us-central1-b-master].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-us-central1-b-master-https].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-us-central1-b-minion-all].\r\nDeleting routes jenkins-us-central1-b-b20b137d-2424-11e6-af1c-42010af00006\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/routes/jenkins-us-central1-b-b20b137d-2424-11e6-af1c-42010af00006].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/regions/us-central1/addresses/jenkins-us-central1-b-master-ip].\r\nproperty \"clusters.k8s-jkns-e2e-gce-federation_jenkins-us-central1-b\" unset.\r\nproperty \"users.k8s-jkns-e2e-gce-federation_jenkins-us-central1-b\" unset.\r\nproperty \"users.k8s-jkns-e2e-gce-federation_jenkins-us-central1-b-basic-auth\" unset.\r\nproperty \"contexts.k8s-jkns-e2e-gce-federation_jenkins-us-central1-b\" unset.\r\nCleared config for k8s-jkns-e2e-gce-federation_jenkins-us-central1-b from /workspace/.kube/config\r\nDone\r\nSetting zone vars to: federation-e2e-gce-us-central1-f\r\nNo resources found\r\nShutting down test cluster in background.\r\nERROR: (gcloud.compute.firewall-rules.delete) Some requests did not succeed:\r\n - The resource 'projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-http-alt' was not found\r\n\r\nERROR: (gcloud.compute.firewall-rules.delete) Some requests did not succeed:\r\n - The resource 'projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-e2e-minion-jenkins-e2e-nodeports' was not found\r\n\r\nBringing down cluster using provider: gce\r\n\r\nAll components are up to date.\r\n\r\nAll components are up to date.\r\n\r\nAll components are up to date.\r\nProject: k8s-jkns-e2e-gce-federation\r\nZone: us-central1-f\r\nINSTANCE_GROUPS=jenkins-us-central1-f-minion-group\r\nNODE_NAMES=jenkins-us-central1-f-minion-group-a60c jenkins-us-central1-f-minion-group-ha2q jenkins-us-central1-f-minion-group-zvjf\r\nBringing down cluster\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-f/instanceGroupManagers/jenkins-us-central1-f-minion-group].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/instanceTemplates/jenkins-us-central1-f-minion-template].\r\nUpdated [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-f/instances/jenkins-us-central1-f-master].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/zones/us-central1-f/instances/jenkins-us-central1-f-master].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-us-central1-f-master-https].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/firewalls/jenkins-us-central1-f-minion-all].\r\nDeleting routes jenkins-us-central1-f-5a642d85-2425-11e6-8322-42010af0000a\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/global/routes/jenkins-us-central1-f-5a642d85-2425-11e6-8322-42010af0000a].\r\nDeleted [https://www.googleapis.com/compute/v1/projects/k8s-jkns-e2e-gce-federation/regions/us-central1/addresses/jenkins-us-central1-f-master-ip].\r\nproperty \"clusters.k8s-jkns-e2e-gce-federation_jenkins-us-central1-f\" unset.\r\nproperty \"users.k8s-jkns-e2e-gce-federation_jenkins-us-central1-f\" unset.\r\nproperty \"users.k8s-jkns-e2e-gce-federation_jenkins-us-central1-f-basic-auth\" unset.\r\nproperty \"contexts.k8s-jkns-e2e-gce-federation_jenkins-us-central1-f\" unset.\r\nCleared config for k8s-jkns-e2e-gce-federation_jenkins-us-central1-f from /workspace/.kube/config\r\nDone\r\n2016/05/27 09:24:16 e2e.go:214: Step 'teardown' finished in 13m13.226815662s\r\n+ exit 1\r\n+ chmod -R o+r /workspace/_artifacts\r\n+ rc=1\r\n+ [[ 1 -ne 0 ]]\r\n+ [[ -x kubernetes/cluster/log-dump.sh ]]\r\n+ [[ 1 -eq 124 ]]\r\n+ [[ 1 -eq 137 ]]\r\n+ [[ 1 -ne 0 ]]\r\n+ echo 'Build failed'\r\nBuild failed\r\n+ echo 'Exiting with code: 1'\r\nExiting with code: 1\r\n+ exit 1\r\nBuild step 'Execute shell' marked build as failure\r\n```\r\nRecording test results\r\nERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?\r\n[PostBuildScript] - Execution post build scripts.\r\n[kubernetes-e2e-gce-federation] $ /bin/bash -xe /tmp/hudson2665859571424393189.sh\r\n+ mkdir -p _tmp\r\n+ curl -fsS --retry 3 https://raw.githubusercontent.com/kubernetes/kubernetes/master/hack/jenkins/upload-to-gcs.sh\r\n+ chmod +x ./_tmp/upload-to-gcs.sh\r\n[Current build status] check if current [FAILURE] is worse or equals then [SUCCESS] and better or equals then [SUCCESS]\r\nRun condition [Current build status] preventing perform for step [Execute shell]\r\n[Current build status] check if current [FAILURE] is worse or equals then [UNSTABLE] and better or equals then [UNSTABLE]\r\nRun condition [Current build status] preventing perform for step [Execute shell]\r\n[Current build status] check if current [FAILURE] is worse or equals then [FAILURE] and better or equals then [FAILURE]\r\nRun condition [Current build status] enabling perform for step [Execute shell]\r\n[kubernetes-e2e-gce-federation] $ /bin/bash -xe /tmp/hudson7673132838991460213.sh\r\n+ JENKINS_BUILD_FINISHED=FAILURE\r\n+ ./_tmp/upload-to-gcs.sh\r\nRun finished at Fri May 27 09:24:19 PDT 2016\r\nUploading to gs://kubernetes-jenkins/logs/kubernetes-e2e-gce-federation/27 (attempt 1)\r\nUploading build result: FAILURE\r\nUploading artifacts\r\nMarking build 27 as the latest completed build\r\n\r\n\r\n\r\n*** View logs and artifacts at https://console.cloud.google.com/storage/browser/kubernetes-jenkins/logs/kubernetes-e2e-gce-federation/27 ***\r\n\r\n\r\n[Current build status] check if current [FAILURE] is worse or equals then [ABORTED] and better or equals then [ABORTED]\r\nRun condition [Current build status] preventing perform for step [Execute shell]\r\n[Google Cloud Storage Uploader] Uploading: build-log.txt\r\n[BFA] Scanning build for known causes...\r\n..........[BFA] Found failure cause(s):\r\n[BFA] Error starting e2e cluster from category setup\r\n[BFA] Done. 10s\r\nEmail was triggered for: Failure - Any\r\nSending email for trigger: Failure - Any\r\n```"}}
{"actor":{"display_login":"quinton-hoole"}}