{"action":"created","issue":{"url":"https://api.github.com/repos/openshift-kni/install-scripts/issues/100","repository_url":"https://api.github.com/repos/openshift-kni/install-scripts","labels_url":"https://api.github.com/repos/openshift-kni/install-scripts/issues/100/labels{/name}","comments_url":"https://api.github.com/repos/openshift-kni/install-scripts/issues/100/comments","events_url":"https://api.github.com/repos/openshift-kni/install-scripts/issues/100/events","html_url":"https://github.com/openshift-kni/install-scripts/issues/100","id":491067556,"node_id":"MDU6SXNzdWU0OTEwNjc1NTY=","number":100,"title":"master don't come back online after reboot in 99_post_install - etcd member pod not running","user":{"login":"sreichar","id":4457282,"node_id":"MDQ6VXNlcjQ0NTcyODI=","avatar_url":"https://avatars1.githubusercontent.com/u/4457282?v=4","gravatar_id":"","url":"https://api.github.com/users/sreichar","html_url":"https://github.com/sreichar","followers_url":"https://api.github.com/users/sreichar/followers","following_url":"https://api.github.com/users/sreichar/following{/other_user}","gists_url":"https://api.github.com/users/sreichar/gists{/gist_id}","starred_url":"https://api.github.com/users/sreichar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sreichar/subscriptions","organizations_url":"https://api.github.com/users/sreichar/orgs","repos_url":"https://api.github.com/users/sreichar/repos","events_url":"https://api.github.com/users/sreichar/events{/privacy}","received_events_url":"https://api.github.com/users/sreichar/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2019-09-09T12:32:09Z","updated_at":"2019-09-11T17:08:19Z","closed_at":null,"author_association":"COLLABORATOR","body":"[kni@worker-0 logs]$ cat 99_post_install-2019-09-07-190210.log \r\n+ source common.sh\r\n++++ dirname common.sh\r\n+++ cd .\r\n+++ pwd\r\n++ SCRIPTDIR=/home/kni/install-scripts/OpenShift\r\n+++ whoami\r\n++ USER=kni\r\n++ '[' -z '' ']'\r\n++ '[' -f /home/kni/install-scripts/OpenShift/config_kni.sh ']'\r\n++ echo 'Using CONFIG /home/kni/install-scripts/OpenShift/config_kni.sh'\r\nUsing CONFIG /home/kni/install-scripts/OpenShift/config_kni.sh\r\n++ CONFIG=/home/kni/install-scripts/OpenShift/config_kni.sh\r\n++ source /home/kni/install-scripts/OpenShift/config_kni.sh\r\n+++ set +x\r\n+++ export INT_IF=eno2\r\n+++ INT_IF=eno2\r\n+++ export PRO_IF=eno1\r\n+++ PRO_IF=eno1\r\n++ export LIBVIRT_DEFAULT_URI=qemu:///system\r\n++ LIBVIRT_DEFAULT_URI=qemu:///system\r\n++ '[' kni '!=' root -a /run/user/1000 == /run/user/0 ']'\r\n++ sudo -n uptime\r\n+++ awk -F= '/^VERSION_ID=/ { print $2 }' /etc/os-release\r\n+++ cut -f1 -d.\r\n+++ tr -d '\"'\r\n++ VER=8\r\n+++ tr -d '\"'\r\n+++ awk -F= '/^ID=/ { print $2 }' /etc/os-release\r\n++ [[ rhel != \\r\\h\\e\\l ]]\r\n++ [[ 8 -ne 8 ]]\r\n++ '[' 3940 = 0 ']'\r\n+ export KUBECONFIG=ocp/auth/kubeconfig\r\n+ KUBECONFIG=ocp/auth/kubeconfig\r\n+ POSTINSTALL_ASSETS_DIR=./assets/post-install\r\n+ IFCFG_INTERFACE=./assets/post-install/ifcfg-interface.template\r\n+ IFCFG_BRIDGE=./assets/post-install/ifcfg-bridge.template\r\n+ BREXT_FILE=./assets/post-install/99-brext-master.yaml\r\n+ export bridge=brext\r\n+ bridge=brext\r\n+ create_bridge\r\n+ echo 'Deploying Bridge brext...'\r\nDeploying Bridge brext...\r\n++ head -1\r\n++ oc get node -o 'custom-columns=IP:.status.addresses[0].address' --no-headers\r\n+ FIRST_MASTER=10.19.1.231\r\n++ ssh -q -o StrictHostKeyChecking=no core@10.19.1.231 'ip r | grep default | grep -Po  '\\''(?<=dev )(\\S+)'\\'''\r\n+ export interface=eno2\r\n+ interface=eno2\r\n+ '[' eno2 == '' ']'\r\n+ '[' eno2 '!=' brext ']'\r\n+ echo 'Using interface eno2'\r\nUsing interface eno2\r\n++ envsubst\r\n++ base64 -w0\r\n+ export interface_content=REVWSUNFPWVubzIKQlJJREdFPWJyZXh0Ck9OQk9PVD15ZXMKTk1fQ09OVFJPTExFRD15ZXMKQk9PVFBST1RPPW5vbmUK\r\n+ interface_content=REVWSUNFPWVubzIKQlJJREdFPWJyZXh0Ck9OQk9PVD15ZXMKTk1fQ09OVFJPTExFRD15ZXMKQk9PVFBST1RPPW5vbmUK\r\n++ envsubst\r\n++ base64 -w0\r\n+ export bridge_content=REVWSUNFPWJyZXh0Ck5BTUU9YnJleHQKVFlQRT1CcmlkZ2UKT05CT09UPXllcwpOTV9DT05UUk9MTEVEPXllcwpCT09UUFJPVE89ZGhjcApCUklER0lOR19PUFRTPXZsYW5fZmlsdGVyaW5nPTEKQlJJREdFX1ZMQU5TPSIxIHB2aWQgdW50YWdnZWQsMjAsMzAwLTQwMCB1bnRhZ2dlZCIK\r\n+ bridge_content=REVWSUNFPWJyZXh0Ck5BTUU9YnJleHQKVFlQRT1CcmlkZ2UKT05CT09UPXllcwpOTV9DT05UUk9MTEVEPXllcwpCT09UUFJPVE89ZGhjcApCUklER0lOR19PUFRTPXZsYW5fZmlsdGVyaW5nPTEKQlJJREdFX1ZMQU5TPSIxIHB2aWQgdW50YWdnZWQsMjAsMzAwLTQwMCB1bnRhZ2dlZCIK\r\n+ envsubst\r\n+ echo 'Done creating bridge definition'\r\nDone creating bridge definition\r\n+ apply_mc\r\n+ for node_type in master worker\r\n+ oc patch --type=merge '--patch={\"spec\":{\"paused\":true}}' machineconfigpool/master\r\nmachineconfigpool.machineconfiguration.openshift.io/master patched\r\n+ for node_type in master worker\r\n+ oc patch --type=merge '--patch={\"spec\":{\"paused\":true}}' machineconfigpool/worker\r\nmachineconfigpool.machineconfiguration.openshift.io/worker patched\r\n+ '[' '' '!=' '' ']'\r\n+ for node_type in master worker\r\n++ find ./assets/post-install -iname '*-master.yaml' -type f\r\n+ test ./assets/post-install/99-brext-master.yaml\r\n+ echo 'Applying machine configs...'\r\nApplying machine configs...\r\n+ oc create -f ./assets/post-install/99-brext-master.yaml\r\nmachineconfig.machineconfiguration.openshift.io/99-brext-master created\r\n+ oc patch --type=merge '--patch={\"spec\":{\"paused\":false}}' machineconfigpool/master\r\nmachineconfigpool.machineconfiguration.openshift.io/master patched\r\n+ echo 'Rebooting nodes...'\r\nRebooting nodes...\r\n+ sleep 30\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (Timeout): the server was unable to return a response in the time allotted, but may still be processing the request\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nUnable to connect to the server: unexpected EOF\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nError from server (NotFound): the server could not find the requested resource (get machineconfigpools.machineconfiguration.openshift.io master)\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n+ sleep 1\r\n+ oc wait mcp/master --for condition=updated --timeout 600s\r\nerror: timed out waiting for the condition on machineconfigpools/master\r\n.\r\n.\r\n.\r\n"},"comment":{"url":"https://api.github.com/repos/openshift-kni/install-scripts/issues/comments/530474237","html_url":"https://github.com/openshift-kni/install-scripts/issues/100#issuecomment-530474237","issue_url":"https://api.github.com/repos/openshift-kni/install-scripts/issues/100","id":530474237,"node_id":"MDEyOklzc3VlQ29tbWVudDUzMDQ3NDIzNw==","user":{"login":"e-minguez","id":346758,"node_id":"MDQ6VXNlcjM0Njc1OA==","avatar_url":"https://avatars3.githubusercontent.com/u/346758?v=4","gravatar_id":"","url":"https://api.github.com/users/e-minguez","html_url":"https://github.com/e-minguez","followers_url":"https://api.github.com/users/e-minguez/followers","following_url":"https://api.github.com/users/e-minguez/following{/other_user}","gists_url":"https://api.github.com/users/e-minguez/gists{/gist_id}","starred_url":"https://api.github.com/users/e-minguez/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/e-minguez/subscriptions","organizations_url":"https://api.github.com/users/e-minguez/orgs","repos_url":"https://api.github.com/users/e-minguez/repos","events_url":"https://api.github.com/users/e-minguez/events{/privacy}","received_events_url":"https://api.github.com/users/e-minguez/received_events","type":"User","site_admin":false},"created_at":"2019-09-11T17:08:19Z","updated_at":"2019-09-11T17:08:19Z","author_association":"COLLABORATOR","body":"See the bugzilla. It seems there is a weird issue under the hood."}}
{"actor":{"display_login":"e-minguez"}}