<p>I have a Kubernetes cluster and I have tested submitting 1,000 jobs at a time and the cluster has no problem handling this. I am interested in submitting 50,000 to 100,000 jobs and was wondering if the cluster would be able to handle this?</p>

magladde
<p>Yes you can but only if only don't run out of resources or you don't exceed this <a href="https://kubernetes.io/docs/setup/best-practices/cluster-large/#support" rel="nofollow noreferrer">criteria</a> regarding building large clusters.</p>

<p>Usually you want to limit your jobs in some way in order to better handle memory and CPU or to adjust it in any other way according to your needs. </p>

<p>So the best practice in your case would be to:</p>

<ul>
<li>set as many jobs as you want (bear in mind the building large clusters criteria)</li>
<li>observe the resource usage</li>
<li>if needed use for example <a href="https://kubernetes.io/docs/concepts/policy/resource-quotas/" rel="nofollow noreferrer">Resource Quotas</a> in order to limit resources used by the jobs</li>
</ul>

<p>I hope you find this helpful. </p>
