<p>I am new at Kubernetes and completely new to setting it up in <code>EKS</code>.</p>
<p>I am trying to achieve sharing of <code>GPU</code> between multiple pods, but for that going through few of the documents and articles, I found out I should update the <code>kube-scheduler configuration</code> with parameters which will then allow me the make the necessary changes for enabling sharing of <code>GPU</code> between pods.</p>
<p><strong>Question</strong></p>
<p>How do I update the <code>kube-scheduler</code> configuration in <code>EKS</code>. If update for the configuration is not possible, is there some other way I can setup <code>kube-scheduler</code> for only those pods which require <code>GPU</code> ?</p>

<p>I think you need a custom kubescheduler, and for your pods to be able to specify whether they want to use the default or the custom scheduler.</p>
<p>Kubernetes supports this: <a href="https://kubernetes.io/docs/tasks/extend-kubernetes/configure-multiple-schedulers/" rel="nofollow noreferrer">https://kubernetes.io/docs/tasks/extend-kubernetes/configure-multiple-schedulers/</a> -- basically, create a .yaml file, run <code>kubectl create -f</code> on it, and you should see your scheduler. You'll want to run it in the <code>kube-system</code> namespace, and give it a unique name (so your pods have a way of saying which scheduler they want).</p>
<p>I haven't done this in EKS myself, but would be very surprised if you couldn't run a custom scheduler in EKS. Moreover, this aws blog post <a href="https://aws.amazon.com/blogs/opensource/virtual-gpu-device-plugin-for-inference-workload-in-kubernetes/" rel="nofollow noreferrer">https://aws.amazon.com/blogs/opensource/virtual-gpu-device-plugin-for-inference-workload-in-kubernetes/</a> , which sounds similar to what you're looking for, seems like it would require a custom scheduler.</p>
