<p>I'm getting a weird bug: The pod is reported as running via k8s api-server. But the container that runnig the application was actually exited, only the pause container <code>gcr.io/google_containers/pause:0.8.0</code> is running, not the actual container.</p>

<pre><code>$ docker ps -a | grep ms-issue
1754ddbbfbd8        agencyrev/workflow.microservice.issue:v0.0.9                          "npm start"            2 days ago          Exited (1) 11 hours ago                       k8s_workflow-microservice-issue.458c077c_rc--ms-issue--v0.0.9-btryt_staging_18d44bae-dac7-11e5-889c-00155d08db02_965dee2f
30c0addd88ef        gcr.io/google_containers/pause:0.8.0                                  "/pause"               2 days ago          Up 2 days                                     k8s_POD.b5de0404_rc--ms-issue--v0.0.9-btryt_staging_18d44bae-dac7-11e5-889c-00155d08db02_e427af83
</code></pre>

<p>As you can see, the app container was exited 11 hours ago, but the <code>/pause::0.8.0</code> is still running, that why it is reported as running.
I noticed this issue because I kept getting error <code>Dial failed: connection refused</code> in the <code>kube-proxy</code>. And not just this pod, I got some other pods (same host) that ran into this as well.</p>

<p>I don't know what caused it, but is that possible? And how?</p>

<p>I'm using kubernetes version v1.1.7</p>

<pre><code>$ kubetctl version
Client Version: version.Info{Major:"1", Minor:"1", GitVersion:"v1.1.7", GitCommit:"e4e6878293a339e4087dae684647c9e53f1cf9f0", GitTreeState:"clean"}
Server Version: version.Info{Major:"1", Minor:"1", GitVersion:"v1.1.7", GitCommit:"e4e6878293a339e4087dae684647c9e53f1cf9f0", GitTreeState:"clean"}

$ docker version
Client version: 1.7.1
Client API version: 1.19
Go version (client): go1.4.2
Git commit (client): 2c2c52b-dirty
OS/Arch (client): linux/amd64
Server version: 1.7.1
Server API version: 1.19
Go version (server): go1.4.2
Git commit (server): 2c2c52b-dirty
OS/Arch (server): linux/amd64

$ uname -a
Linux dev-coreos-k8s_14 4.1.5-coreos #2 SMP Thu Aug 13 09:18:45 UTC 2015 x86_64 Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz GenuineIntel GNU/Linux
</code></pre>

<p>The issue above leads to other issue, that I cannot stop the pod without <code>--grace-period=0</code> option (the status was always at <code>Terminating</code> with default grace-period 30s). And even if after the pod was stopped, the <code>pause</code> container is still there. I had to stop it with <code>docker stop</code></p>

<p>This seems to be specific to that pod/image you are running. Can you check the logs and see why that pod exited ? Can you try any other image from docker hub ? </p>
