<p>Is there a way we can share the GPU between multiple pods or we need some specific model of NVIDIA GPUS?</p>

<blockquote>
<p>Short answer, yes :)</p>
</blockquote>
<p>Long answer below :)</p>
<p>There is no &quot;built-in&quot; solution to achieve that, but you can use many tools (plugins) to control GPU. First look at the <a href="https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus/#v1-8-onwards" rel="nofollow noreferrer">Kubernetes official site</a>:</p>
<blockquote>
<p>Kubernetes includes  <strong>experimental</strong>  support for managing AMD and NVIDIA GPUs (graphical processing units) across several nodes.</p>
<p>This page describes how users can consume GPUs across different Kubernetes versions and the current limitations.</p>
</blockquote>
<p>Look also about limitations:</p>
<blockquote>
<ul>
<li>GPUs are only supposed to be specified in the  <code>limits</code>  section, which means:
-   You can specify GPU  <code>limits</code>  without specifying  <code>requests</code>  because Kubernetes will use the limit as the request value by default.
-   You can specify GPU in both  <code>limits</code>  and  <code>requests</code>  but these two values must be equal.
-   You cannot specify GPU  <code>requests</code>  without specifying  <code>limits</code>.</li>
<li>Containers (and Pods) do not share GPUs. There's no overcommitting of GPUs.</li>
<li>Each container can request one or more GPUs. It is not possible to request a fraction of a GPU.</li>
</ul>
</blockquote>
<p>As you can see this supports GPUs between several nodes.  You can find the <a href="https://kubernetes.io/docs/tasks/manage-gpus/scheduling-gpus/#deploying-nvidia-gpu-device-plugin" rel="nofollow noreferrer">guide</a> how to deploy it.</p>
<p>Additionally, if you don't specify this in resource / request limits, the <strong>containers</strong> from all pods will have full access to the GPU as if they were normal processes. There is no need to do anything in this case.</p>
<p>For more look also at <a href="https://github.com/kubernetes/kubernetes/issues/52757" rel="nofollow noreferrer">this github topic</a>.</p>
