{"action":"created","issue":{"url":"https://api.github.com/repos/contiv/ansible/issues/135","repository_url":"https://api.github.com/repos/contiv/ansible","labels_url":"https://api.github.com/repos/contiv/ansible/issues/135/labels{/name}","comments_url":"https://api.github.com/repos/contiv/ansible/issues/135/comments","events_url":"https://api.github.com/repos/contiv/ansible/issues/135/events","html_url":"https://github.com/contiv/ansible/issues/135","id":142783712,"number":135,"title":"Node status is 'Allocated' though it remains isolated from cluster","user":{"login":"rkharya","id":12057795,"avatar_url":"https://avatars.githubusercontent.com/u/12057795?v=3","gravatar_id":"","url":"https://api.github.com/users/rkharya","html_url":"https://github.com/rkharya","followers_url":"https://api.github.com/users/rkharya/followers","following_url":"https://api.github.com/users/rkharya/following{/other_user}","gists_url":"https://api.github.com/users/rkharya/gists{/gist_id}","starred_url":"https://api.github.com/users/rkharya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rkharya/subscriptions","organizations_url":"https://api.github.com/users/rkharya/orgs","repos_url":"https://api.github.com/users/rkharya/repos","events_url":"https://api.github.com/users/rkharya/events{/privacy}","received_events_url":"https://api.github.com/users/rkharya/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-03-22T21:16:45Z","updated_at":"2016-03-22T21:28:16Z","closed_at":null,"body":"9 node scale cluster. One node status allocated but fails to join cluster -\r\n\r\n},\r\n    \"contiv-aci-scale-6-FCH1924V2F6\": {\r\n        \"name\": \"contiv-aci-scale-6-FCH1924V2F6\",\r\n        \"status\": \"Allocated\",\r\n        \"prev-status\": \"Incomplete\",\r\n        \"state\": \"Discovered\",\r\n        \"prev-state\": \"Unknown\"\r\n    },\r\n\r\n[admin@contiv-aci-scale-6 ~]$ sudo docker ps\r\nCONTAINER ID        IMAGE               COMMAND             CREATED             STATUS              PORTS               NAMES\r\n\r\n[admin@contiv-aci-scale-6 ~]$ sudo systemctl status -l -n 50 ucp\r\n● ucp.service - Ucp\r\n   Loaded: loaded (/etc/systemd/system/ucp.service; static; vendor preset: disabled)\r\n   Active: failed (Result: exit-code) since Tue 2016-03-22 10:21:11 PDT; 3h 52min ago\r\n Main PID: 25189 (code=exited, status=1/FAILURE)\r\n\r\nMar 22 10:21:08 contiv-aci-scale-6.cisco.com systemd[1]: Started Ucp.\r\nMar 22 10:21:08 contiv-aci-scale-6.cisco.com systemd[1]: Starting Ucp...\r\nMar 22 10:21:08 contiv-aci-scale-6.cisco.com ucp.sh[25189]: starting ucp on contiv-aci-scale-6-FCH1924V2F6[10.193.231.62]\r\nMar 22 10:21:08 contiv-aci-scale-6.cisco.com ucp.sh[25189]: INFO[0000] All required images are present\r\nMar 22 10:21:09 contiv-aci-scale-6.cisco.com ucp.sh[25189]: INFO[0000] This engine will join UCP and advertise itself with host address 10.193.231.62 - If this is incorrect, please specify an alternative address with the '--host-address' flag\r\nMar 22 10:21:09 contiv-aci-scale-6.cisco.com ucp.sh[25189]: INFO[0000] Verifying your system is compatible with UCP\r\nMar 22 10:21:10 contiv-aci-scale-6.cisco.com ucp.sh[25189]: ERRO[0001] Server response: the system is unlicensed\r\nMar 22 10:21:10 contiv-aci-scale-6.cisco.com ucp.sh[25189]: FATA[0001] Failed to add host to UCP: the system is unlicensed\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com systemd[1]: ucp.service: main process exited, code=exited, status=1/FAILURE\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: docker: \"stop\" requires a minimum of 1 argument.\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: See 'docker stop --help'.\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: Usage:        docker stop [OPTIONS] CONTAINER [CONTAINER...]\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: Stop a running container.\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: Sending SIGTERM and then SIGKILL after a grace period\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: docker: \"rm\" requires a minimum of 1 argument.\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: See 'docker rm --help'.\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: Usage:        docker rm [OPTIONS] CONTAINER [CONTAINER...]\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com ucp.sh[25412]: Remove one or more containers\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com systemd[1]: ucp.service: control process exited, code=exited status=123\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com systemd[1]: Unit ucp.service entered failed state.\r\nMar 22 10:21:11 contiv-aci-scale-6.cisco.com systemd[1]: ucp.service failed.\r\n\r\nWhen try to de-commission this node, it aborts with below message -\r\n\r\n[admin@contiv-aci-scale-1 ~]$ clusterctl node decommission contiv-aci-scale-6-FCH1924V2F6\r\nFATA[0000] Request: decommission/node/contiv-aci-scale-6-FCH1924V2F6 Response status: \"500 Internal Server Error\". Response body: \"contiv-aci-scale-6-FCH1924V2F6\" is a master node and it can only be decommissioned after all worker nodes have been decommissioned\r\n\r\nThis node was never tried to commissioned as first node - it was not expected to run a master-node."},"comment":{"url":"https://api.github.com/repos/contiv/ansible/issues/comments/200037143","html_url":"https://github.com/contiv/ansible/issues/135#issuecomment-200037143","issue_url":"https://api.github.com/repos/contiv/ansible/issues/135","id":200037143,"user":{"login":"mapuri","id":9538438,"avatar_url":"https://avatars.githubusercontent.com/u/9538438?v=3","gravatar_id":"","url":"https://api.github.com/users/mapuri","html_url":"https://github.com/mapuri","followers_url":"https://api.github.com/users/mapuri/followers","following_url":"https://api.github.com/users/mapuri/following{/other_user}","gists_url":"https://api.github.com/users/mapuri/gists{/gist_id}","starred_url":"https://api.github.com/users/mapuri/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mapuri/subscriptions","organizations_url":"https://api.github.com/users/mapuri/orgs","repos_url":"https://api.github.com/users/mapuri/repos","events_url":"https://api.github.com/users/mapuri/events{/privacy}","received_events_url":"https://api.github.com/users/mapuri/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T21:28:16Z","updated_at":"2016-03-22T21:28:16Z","body":"@rkharya \r\n\r\nthanks for sharing ansible logs, that helped. The service had failed due to ucp license issue `Failed to add host to UCP: the system is unlicensed`\r\n\r\nBut I think you mentioned that UCP service shows up as running, is that still the case? From here it looks like service has exited. If not I think we can close this issue.\r\n\r\n> When try to de-commission this node, it aborts with below message -\r\n> [admin@contiv-aci-scale-1 ~]$ clusterctl node decommission contiv-aci-scale-6-FCH1924V2F6\r\nFATA[0000] Request: decommission/node/contiv-aci-scale-6-FCH1924V2F6 Response status: \"500 Internal Server Error\". Response body: \"contiv-aci-scale-6-FCH1924V2F6\" is a master node and it can only be decommissioned after all worker nodes have been decommissioned\r\n> This node was never tried to commissioned as first node - it was not expected to run a master-node.\r\n\r\nI think for better tracking this behavior needs to be tracked in cluster repo. Can you also list the steps to reproduce this behavior when you file the issue in cluster repo? Thanks. "}}