{"action":"opened","issue":{"url":"https://api.github.com/repos/docker/docker/issues/29343","repository_url":"https://api.github.com/repos/docker/docker","labels_url":"https://api.github.com/repos/docker/docker/issues/29343/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/29343/comments","events_url":"https://api.github.com/repos/docker/docker/issues/29343/events","html_url":"https://github.com/docker/docker/issues/29343","id":195151457,"number":29343,"title":"cannot stop/connect service container on swarm cluster","user":{"login":"shankarkc","id":4651863,"avatar_url":"https://avatars.githubusercontent.com/u/4651863?v=3","gravatar_id":"","url":"https://api.github.com/users/shankarkc","html_url":"https://github.com/shankarkc","followers_url":"https://api.github.com/users/shankarkc/followers","following_url":"https://api.github.com/users/shankarkc/following{/other_user}","gists_url":"https://api.github.com/users/shankarkc/gists{/gist_id}","starred_url":"https://api.github.com/users/shankarkc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shankarkc/subscriptions","organizations_url":"https://api.github.com/users/shankarkc/orgs","repos_url":"https://api.github.com/users/shankarkc/repos","events_url":"https://api.github.com/users/shankarkc/events{/privacy}","received_events_url":"https://api.github.com/users/shankarkc/received_events","type":"User","site_admin":false},"labels":[{"id":73641990,"url":"https://api.github.com/repos/docker/docker/labels/area/runtime","name":"area/runtime","color":"fbca04","default":false},{"id":392678049,"url":"https://api.github.com/repos/docker/docker/labels/area/swarm","name":"area/swarm","color":"fbca04","default":false},{"id":375714123,"url":"https://api.github.com/repos/docker/docker/labels/version/1.12","name":"version/1.12","color":"ededed","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-12-13T03:32:36Z","updated_at":"2016-12-13T03:32:36Z","closed_at":null,"body":"I have created a service. One of its container turned zombie. Containers uses tini to avoid zombie containers. But i still hit this issue.\r\n\r\nContainer doesnt respond to docker connect/stop command\r\n\r\n**Steps to reproduce the issue:**\r\n1. check the containers ID and try to connect to it OR try to stop it.\r\n```\r\nroot@mo-7ecf25ab6:~# docker ps\r\nCONTAINER ID        IMAGE                                      COMMAND                  CREATED             STATUS              PORTS                NAMES\r\n2a125ed7e9d2        registry.mo.sap.corp:5004/ai/node:0.0.23   \"/tini -- /opt/seleni\"   16 hours ago        Up 16 hours         3000/tcp, 5555/tcp   SeleniumNode.7.bf7nyrzl9l2r5w2u4nzhzt3wn\r\n\r\nroot@mo-7ecf25ab6:~# docker exec -it 2a125ed7e9d2 bash\r\nrpc error: code = 13 desc = invalid header field value \"oci runtime error: exec failed: container_linux.go:247: starting container process caused \\\"process_linux.go:83: executing setns process caused \\\\\\\"exit status 16\\\\\\\"\\\"\\n\"\r\n\r\nroot@mo-7ecf25ab6:~# docker stop 2a125ed7e9d2\r\n^C\r\n```\r\n**Describe the results you received:**\r\nConnecting to docker container gives the error shown above.\r\ndocker stop CONTAINERID hangs.\r\nEven docker service restart wont help to get rid of this zombie container\r\nHere is the upstart log...\r\n```\r\ntime=\"2016-12-13T03:12:40.473657504Z\" level=info msg=\"Container 2a125ed7e9d2f91d037a7dd097aeee42fe7dd688fb22015f59adbe256c835e68 failed to exit within 10 seconds of signal 15 - using the force\"\r\ntime=\"2016-12-13T03:12:50.475221412Z\" level=info msg=\"Container 2a125ed7e9d2 failed to exit within 10 seconds of kill - trying direct SIGKILL\"\r\ntime=\"2016-12-13T03:14:12.506438976Z\" level=error msg=\"Error running exec in container: rpc error: code = 13 desc = invalid header field value \\\"oci runtime error: exec failed: container_linux.go:247: starting container process caused \\\\\\\"process_linux.go:83: executing setns process caused \\\\\\\\\\\\\\\"exit status 16\\\\\\\\\\\\\\\"\\\\\\\"\\\\n\\\"\"\r\ntime=\"2016-12-13T03:14:12.506892670Z\" level=error msg=\"Handler for POST /v1.24/exec/488fa7b76e82a56362b604ae248bca58286cf170fe4b863540a8a36e16bc3c0d/resize returned error: rpc error: code = 2 desc = containerd: process not found for container\"\r\ntime=\"2016-12-13T03:15:11.929252959Z\" level=info msg=\"Container 2a125ed7e9d2f91d037a7dd097aeee42fe7dd688fb22015f59adbe256c835e68 failed to exit within 10 seconds of signal 15 - using the force\"\r\ntime=\"2016-12-13T03:15:16.930656043Z\" level=error msg=\"Handler for DELETE /v1.24/containers/2a125ed7e9d2 returned error: You cannot remove a running container 2a125ed7e9d2f91d037a7dd097aeee42fe7dd688fb22015f59adbe256c835e68. Stop the container before attempting removal or use -f\"\r\ntime=\"2016-12-13T03:15:21.930249727Z\" level=info msg=\"Container 2a125ed7e9d2 failed to exit within 10 seconds of kill - trying direct SIGKILL\"\r\ntime=\"2016-12-13T03:20:01.834086435Z\" level=info msg=\"Container 2a125ed7e9d2f91d037a7dd097aeee42fe7dd688fb22015f59adbe256c835e68 failed to exit within 10 seconds of signal 15 - using the force\"\r\ntime=\"2016-12-13T03:20:11.835354321Z\" level=info msg=\"Container 2a125ed7e9d2 failed to exit within 10 seconds of kill - trying direct SIGKILL\"\r\ntime=\"2016-12-13T03:20:12.305977845Z\" level=info msg=\"Container 2a125ed7e9d2f91d037a7dd097aeee42fe7dd688fb22015f59adbe256c835e68 failed to exit within 10 seconds of signal 15 - using the force\"\r\ntime=\"2016-12-13T03:20:17.306046419Z\" level=error msg=\"Handler for DELETE /v1.24/containers/2a125ed7e9d2 returned error: You cannot remove a running container 2a125ed7e9d2f91d037a7dd097aeee42fe7dd688fb22015f59adbe256c835e68. Stop the container before attempting removal or use -f\"\r\n```\r\n**Describe the results you expected:**\r\n\r\n\r\n**Additional information you deem important (e.g. issue happens only occasionally):**\r\nAs of now only way to getRidOf this container is to uninstall docker and reinstall it. Is this a known issue?\r\nafter this if i restart docker service and execute docker ps command it hangs forever. \r\n\r\n**Output of `docker version`:**\r\n```\r\nClient:\r\n Version:      1.12.3\r\n API version:  1.24\r\n Go version:   go1.6.3\r\n Git commit:   6b644ec\r\n Built:        Wed Oct 26 21:44:32 2016\r\n OS/Arch:      linux/amd64\r\n\r\nServer:\r\n Version:      1.12.3\r\n API version:  1.24\r\n Go version:   go1.6.3\r\n Git commit:   6b644ec\r\n Built:        Wed Oct 26 21:44:32 2016\r\n OS/Arch:      linux/amd64\r\n\r\n```\r\n\r\n\r\n\r\n**Output of `docker info`:**\r\n\r\n```\r\nContainers: 10\r\n Running: 1\r\n Paused: 0\r\n Stopped: 9\r\nImages: 1\r\nServer Version: 1.12.3\r\nStorage Driver: aufs\r\n Root Dir: /var/lib/docker/aufs\r\n Backing Filesystem: extfs\r\n Dirs: 45\r\n Dirperm1 Supported: true\r\nLogging Driver: json-file\r\nCgroup Driver: cgroupfs\r\nPlugins:\r\n Volume: local\r\n Network: host bridge overlay null\r\nSwarm: active\r\n NodeID: cd2wz7idadk07kj7fzjf71vby\r\n Is Manager: false\r\n Node Address: 10.173.77.81\r\nRuntimes: runc\r\nDefault Runtime: runc\r\nSecurity Options: apparmor\r\nKernel Version: 4.2.0-27-generic\r\nOperating System: Ubuntu 14.04.5 LTS\r\nOSType: linux\r\nArchitecture: x86_64\r\nCPUs: 8\r\nTotal Memory: 15.66 GiB\r\nName: mo-7ecf25ab6\r\nID: KFYI:3LXO:3CZL:Q67A:QJER:4HY5:ESFO:3GA7:YL5Q:Q5ZC:NCNZ:DJXC\r\nDocker Root Dir: /var/lib/docker\r\nDebug Mode (client): false\r\nDebug Mode (server): false\r\nRegistry: https://index.docker.io/v1/\r\nWARNING: No swap limit support\r\nLabels:\r\n seleniumNodeType=node\r\nInsecure Registries:\r\n 127.0.0.0/8\r\n```\r\n\r\n\r\n"}}
{"actor":{"display_login":"shankarkc"}}