{"action":"created","issue":{"url":"https://api.github.com/repos/gluster/glusterd2/issues/1157","repository_url":"https://api.github.com/repos/gluster/glusterd2","labels_url":"https://api.github.com/repos/gluster/glusterd2/issues/1157/labels{/name}","comments_url":"https://api.github.com/repos/gluster/glusterd2/issues/1157/comments","events_url":"https://api.github.com/repos/gluster/glusterd2/issues/1157/events","html_url":"https://github.com/gluster/glusterd2/issues/1157","id":349413767,"node_id":"MDU6SXNzdWUzNDk0MTM3Njc=","number":1157,"title":"Peer remove with force throws error but when we check peer status, peer is removed","user":{"login":"Akarsha-rai","id":32188669,"node_id":"MDQ6VXNlcjMyMTg4NjY5","avatar_url":"https://avatars0.githubusercontent.com/u/32188669?v=4","gravatar_id":"","url":"https://api.github.com/users/Akarsha-rai","html_url":"https://github.com/Akarsha-rai","followers_url":"https://api.github.com/users/Akarsha-rai/followers","following_url":"https://api.github.com/users/Akarsha-rai/following{/other_user}","gists_url":"https://api.github.com/users/Akarsha-rai/gists{/gist_id}","starred_url":"https://api.github.com/users/Akarsha-rai/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Akarsha-rai/subscriptions","organizations_url":"https://api.github.com/users/Akarsha-rai/orgs","repos_url":"https://api.github.com/users/Akarsha-rai/repos","events_url":"https://api.github.com/users/Akarsha-rai/events{/privacy}","received_events_url":"https://api.github.com/users/Akarsha-rai/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-10T07:59:05Z","updated_at":"2018-08-10T08:12:58Z","closed_at":null,"author_association":"NONE","body":"Steps:\r\n1) Having 3 node cluster say n1, n2 and n3 and single external etcd.\r\n2) Tried to remove n3 from node n1 with force got the error\r\ncurl -X DELETE http://10.70.35.34:24007/v1/peers/da478ca0-2b84-4b99-a6bc-9edd3b5950ce force\r\ncurl: (6) Could not resolve host: force; Unknown error\r\n3) Checked the peer status from node n1, node n3 was removed even though it threw an error\r\n[root@dhcp35-229 ~]# glustercli peer status\r\n+--------------------------------------+-----------------------------------+--------------------+--------------------+--------+-------+\r\n|                  ID                  |               NAME                |  CLIENT ADDRESSES  |   PEER ADDRESSES   | ONLINE |  PID  |\r\n+--------------------------------------+-----------------------------------+--------------------+--------------------+--------+-------+\r\n| aab46496-065c-4dc3-8010-11435a7428a4 | dhcp35-229.lab.eng.blr.redhat.com | 127.0.0.1:24007    | 10.70.35.229:24008 | yes    | 20241 |\r\n|                                      |                                   | 10.70.35.229:24007 |                    |        |       |\r\n|                                      |                                   | 10.70.35.34:24007  |                    |        |       |\r\n| b7964d08-d68d-4c35-b598-abbd6c2407d0 | dhcp35-163.lab.eng.blr.redhat.com | 127.0.0.1:24007    | 10.70.35.163:24008 | yes    | 20025 |\r\n|                                      |                                   | 10.70.35.163:24007 |                    |        |       |\r\n+--------------------------------------+-----------------------------------+--------------------+--------------------+--------+-------+\r\n27.0.0.1:24007    | 10.70.35.163:24008 | yes    | 20025 |\r\n|                                      |                                   | 10.70.35.163:24007 |                    |        |       |\r\n+--------------------------------------+-----------------------------------+--------------------+--------------------+--------+-------+\r\n\r\nIf the command is wrong, peer shouldn't be removed from the cluster and should throw an appropriate error\r\nLogs:\r\nNode1:\r\ntime=\"2018-08-10 12:18:34.021810\" level=info msg=\"peer disconnected from store\" id=da478ca0-2b84-4b99-a6bc-9edd3b5950ce source=\"[liveness.go:51:events.(*livenessWatcher).Watch]\"\r\ntime=\"2018-08-10 12:18:39.034589\" level=info msg=\"10.70.35.34 - - [10/Aug/2018:12:18:34 +0530] \\\"DELETE /v1/peers/da478ca0-2b84-4b99-a6bc-9edd3b5950ce HTTP/1.1\\\" 204 0\" reqid=c4b09767-a5ab-4a61-abeb-9b5e21cadee6\r\ntime=\"2018-08-10 12:19:20.985605\" level=info msg=\"127.0.0.1 - - [10/Aug/2018:12:19:20 +0530] \\\"GET /v1/peers HTTP/1.1\\\" 200 572\" reqid=52a22000-4933-464e-9657-f16dbea91aa0\r\ntime=\"2018-08-10 12:19:43.123058\" level=info msg=\"127.0.0.1 - - [10/Aug/2018:12:19:43 +0530] \\\"GET /v1/peers HTTP/1.1\\\" 200 572\" reqid=e8def88c-9063-40b6-9b75-844ad70d781d\r\nNode3:\r\ntime=\"2018-08-10 12:18:34.019867\" level=info msg=\"handling incoming leave cluster request\" remotepeer=aab46496-065c-4dc3-8010-11435a7428a4 source=\"[peer-rpc-svc.go:105:peers.(*PeerService).Leave]\"\r\ntime=\"2018-08-10 12:18:34.023784\" level=warning msg=\"failed to close etcd session\" error=\"grpc: the client connection is closing\" source=\"[remote.go:66:store.(*GDStore).closeRemoteStore]\"\r\ntime=\"2018-08-10 12:18:39.024653\" level=error msg=\"failed to create etcd client\" error=\"dial tcp [::1]:2379: getsockopt: connection refused\" source=\"[remote.go:49:store.newRemoteStore]\"\r\ntime=\"2018-08-10 12:18:39.024774\" level=error msg=\"failed to restart store with new endpoints\" endpoints=\"[http://localhost:2379]\" error=\"dial tcp [::1]:2379: getsockopt: connection refused\" source=\"[peer-rpc-svc.go:183:peers.ReconfigureStore]\"\r\ntime=\"2018-08-10 12:18:39.032155\" level=warning msg=\"failed to reconfigure store with defaults\" error=\"dial tcp [::1]:2379: getsockopt: connection refused\" remotepeer=aab46496-065c-4dc3-8010-11435a7428a4 source=\"[peer-rpc-svc.go:146:peers.(*PeerService).Leave]\""},"comment":{"url":"https://api.github.com/repos/gluster/glusterd2/issues/comments/412010487","html_url":"https://github.com/gluster/glusterd2/issues/1157#issuecomment-412010487","issue_url":"https://api.github.com/repos/gluster/glusterd2/issues/1157","id":412010487,"node_id":"MDEyOklzc3VlQ29tbWVudDQxMjAxMDQ4Nw==","user":{"login":"Madhu-1","id":18114231,"node_id":"MDQ6VXNlcjE4MTE0MjMx","avatar_url":"https://avatars2.githubusercontent.com/u/18114231?v=4","gravatar_id":"","url":"https://api.github.com/users/Madhu-1","html_url":"https://github.com/Madhu-1","followers_url":"https://api.github.com/users/Madhu-1/followers","following_url":"https://api.github.com/users/Madhu-1/following{/other_user}","gists_url":"https://api.github.com/users/Madhu-1/gists{/gist_id}","starred_url":"https://api.github.com/users/Madhu-1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Madhu-1/subscriptions","organizations_url":"https://api.github.com/users/Madhu-1/orgs","repos_url":"https://api.github.com/users/Madhu-1/repos","events_url":"https://api.github.com/users/Madhu-1/events{/privacy}","received_events_url":"https://api.github.com/users/Madhu-1/received_events","type":"User","site_admin":false},"created_at":"2018-08-10T08:12:58Z","updated_at":"2018-08-10T08:12:58Z","author_association":"CONTRIBUTOR","body":">curl -X DELETE http://10.70.35.34:24007/v1/peers/da478ca0-2b84-4b99-a6bc-9edd3b5950ce force\r\ncurl: (6) Could not resolve host: force; Unknown error\r\n\r\nwe don't support force for peer remove. the error what you posted is from CURL not from glusterd2\r\n\r\nfrom curl request peer remove was successful."}}
{"actor":{"display_login":"Madhu-1"}}