{"action":"created","issue":{"url":"https://api.github.com/repos/docker/docker/issues/27761","repository_url":"https://api.github.com/repos/docker/docker","labels_url":"https://api.github.com/repos/docker/docker/issues/27761/labels{/name}","comments_url":"https://api.github.com/repos/docker/docker/issues/27761/comments","events_url":"https://api.github.com/repos/docker/docker/issues/27761/events","html_url":"https://github.com/docker/docker/issues/27761","id":185268101,"number":27761,"title":"Deadlock after many create/rm container operations","user":{"login":"tonistiigi","id":585223,"avatar_url":"https://avatars.githubusercontent.com/u/585223?v=3","gravatar_id":"","url":"https://api.github.com/users/tonistiigi","html_url":"https://github.com/tonistiigi","followers_url":"https://api.github.com/users/tonistiigi/followers","following_url":"https://api.github.com/users/tonistiigi/following{/other_user}","gists_url":"https://api.github.com/users/tonistiigi/gists{/gist_id}","starred_url":"https://api.github.com/users/tonistiigi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tonistiigi/subscriptions","organizations_url":"https://api.github.com/users/tonistiigi/orgs","repos_url":"https://api.github.com/users/tonistiigi/repos","events_url":"https://api.github.com/users/tonistiigi/events{/privacy}","received_events_url":"https://api.github.com/users/tonistiigi/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/docker/docker/labels/priority/P1","name":"priority/P1","color":"eb6420"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-10-26T00:30:38Z","updated_at":"2016-10-26T02:06:51Z","closed_at":null,"body":"Dockerd and containerd stacktrace https://gist.github.com/tonistiigi/df8028687858f2f11f0016ac336f8185\r\n\r\n`docker ps` blocked in https://gist.github.com/tonistiigi/df8028687858f2f11f0016ac336f8185#file-docker-stacktrace-L4440-L4442\r\n\r\nOn first look, it seems to be blocked on start waiting on containerd grpc. For example https://gist.github.com/tonistiigi/df8028687858f2f11f0016ac336f8185#file-docker-stacktrace-L4131-L4147 It has already taken container lock but is not releasing it.\r\n\r\nTraces are from https://github.com/docker/docker/commits/32b541e44385206772b30b2a6f241a7c809aa62f\r\n\r\n@mlaventure @crosbymichael "},"comment":{"url":"https://api.github.com/repos/docker/docker/issues/comments/256230544","html_url":"https://github.com/docker/docker/issues/27761#issuecomment-256230544","issue_url":"https://api.github.com/repos/docker/docker/issues/27761","id":256230544,"user":{"login":"mlaventure","id":16065150,"avatar_url":"https://avatars.githubusercontent.com/u/16065150?v=3","gravatar_id":"","url":"https://api.github.com/users/mlaventure","html_url":"https://github.com/mlaventure","followers_url":"https://api.github.com/users/mlaventure/followers","following_url":"https://api.github.com/users/mlaventure/following{/other_user}","gists_url":"https://api.github.com/users/mlaventure/gists{/gist_id}","starred_url":"https://api.github.com/users/mlaventure/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mlaventure/subscriptions","organizations_url":"https://api.github.com/users/mlaventure/orgs","repos_url":"https://api.github.com/users/mlaventure/repos","events_url":"https://api.github.com/users/mlaventure/events{/privacy}","received_events_url":"https://api.github.com/users/mlaventure/received_events","type":"User","site_admin":false},"created_at":"2016-10-26T02:06:51Z","updated_at":"2016-10-26T02:06:51Z","body":"`containerd` is stuck because of an `AddProcess` call [here](https://gist.github.com/tonistiigi/df8028687858f2f11f0016ac336f8185#file-containerd-stacktrace-L143).\r\n\r\nIt's stuck in an infinite loop because [`isAlive`](https://github.com/docker/containerd/blob/52ef1ceb4b660c42cf4ea9013180a5663968d4c7/runtime/container.go#L667) keeps returning `true`, which would mean the `containerd-shim` process associated with the exec is still running somehow.\r\n\r\nThere's 2 scenarios to hit this code path:\r\n 1. The pid file wasn't created\r\n 2. The conversion from `string` to `int` of the pid failed\r\n\r\n@tonistiigi is the machine where it occurred still there? Or can you reproduce it somehow?"}}
{"actor":{"display_login":"mlaventure"}}