{"action":"opened","issue":{"url":"https://api.github.com/repos/pingcap/tidb-operator/issues/70","repository_url":"https://api.github.com/repos/pingcap/tidb-operator","labels_url":"https://api.github.com/repos/pingcap/tidb-operator/issues/70/labels{/name}","comments_url":"https://api.github.com/repos/pingcap/tidb-operator/issues/70/comments","events_url":"https://api.github.com/repos/pingcap/tidb-operator/issues/70/events","html_url":"https://github.com/pingcap/tidb-operator/issues/70","id":355923667,"node_id":"MDU6SXNzdWUzNTU5MjM2Njc=","number":70,"title":"pd never upgrade when pd server is unavailable","user":{"login":"xiaojingchen","id":5999258,"node_id":"MDQ6VXNlcjU5OTkyNTg=","avatar_url":"https://avatars0.githubusercontent.com/u/5999258?v=4","gravatar_id":"","url":"https://api.github.com/users/xiaojingchen","html_url":"https://github.com/xiaojingchen","followers_url":"https://api.github.com/users/xiaojingchen/followers","following_url":"https://api.github.com/users/xiaojingchen/following{/other_user}","gists_url":"https://api.github.com/users/xiaojingchen/gists{/gist_id}","starred_url":"https://api.github.com/users/xiaojingchen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xiaojingchen/subscriptions","organizations_url":"https://api.github.com/users/xiaojingchen/orgs","repos_url":"https://api.github.com/users/xiaojingchen/repos","events_url":"https://api.github.com/users/xiaojingchen/events{/privacy}","received_events_url":"https://api.github.com/users/xiaojingchen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-31T10:18:52Z","updated_at":"2018-08-31T10:18:52Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Some times because of image version error or other misconfiguration, cause pd members starts up failed and the entire pd server is unavailable.  \r\n\r\nAt this time, we hope to recover pd server by automatic upgrade, but according to the current pd manage process, the status synchronization of pd will return error and exit directly. As a result, the subsequent upgrade cannot be executed, the cluster will always block in and cannot be automatically restored except deleted  pd statefulSet manually.\r\n\r\nIn order to avoid the above situation, we must modify the process of pd, do not exit directly when the synchronization pd status fails, but save and pass the flag of whether the state synchronization is successful, and continue to execute the following logic."}}
{"actor":{"display_login":"xiaojingchen"}}