<p>Apparently the GC of my Kubernetes cluster is failing to delete any image and the server is getting to full-disk. </p>

<p>Can you please guide me on where to find the logs for the ImageGC with the error trying to delete the images or to a reason of why this is happening?</p>

<pre><code>3m         5d          1591      ip-xxx.internal     Node                                          Warning   FreeDiskSpaceFailed       {kubelet ip-xxx.internal}     failed to garbage collect required amount of images. Wanted to free 6312950988, but freed 0
3m         5d          1591      ip-xxx.internal     Node                                          Warning   ImageGCFailed             {kubelet ip-xxx.internal}     failed to garbage collect required amount of images. Wanted to free 6312950988, but freed 0
</code></pre>

<p>Thanks!</p>

<p>There may not be much in the way of logs (see <a href="https://github.com/kubernetes/kubernetes/issues/15564" rel="nofollow noreferrer">this issue</a>) but there may be Kubernetes event data. Look for events of type <code>ImageGCFailed</code>.</p>
<p>Alternatively you could check the cadvisor Prometheus metrics to see if it exposes any information about container garbage collecton.</p>
<p>Docs on the GC feature in general: <a href="https://kubernetes.io/docs/concepts/cluster-administration/kubelet-garbage-collection/" rel="nofollow noreferrer">https://kubernetes.io/docs/concepts/cluster-administration/kubelet-garbage-collection/</a></p>
