<p>Recently, there have been a lot of completed pods on the k8s cluster, which I suspect is related to insufficient cluster resources</p>
<p>The nextflow task I created contains several processes, usually they will be executed sequentially, and a new pod will be created after the previous pod is completed. But recently, a large number of tasks have been submitted on the cluster. During the observation process, many completed pods appeared, and the tasks got stuck. I'm wondering if this has something to do with cluster resources or nextflow, and what else could happen if this pod keeps failing to recycle?</p>

xintian
<p>Need more details however if your <strong>POD</strong> are being completed which means code is being executed properly.</p>
<p>In any case, if your <strong>POD</strong> throwing <strong>Error</strong> or <strong>Failed</strong> it should <strong>crash</strong> and not change status to <strong>Completed</strong>.</p>
<p>If there is a resource issue in K8s POD won't schedule at all and will stuck in a <strong>pending</strong> state.</p>
<p>Another case could be POD start <strong>crashing</strong> or get <strong>OOM kill</strong> event so in this case you have to keep checking status of POD.</p>
