<p>While scheduling spark job on kubernetes can we use different node pool for driver and executer pods?</p>

<p>I have gone through documentation of spark 2.4.4 but it only takes one node pool selector config. I was planning to use preemtible nodes in GKE node pool but I wonder if node which is running the driver goes down new instance will not re-run the driver and whole job would fail.</p>

<p>current setting as per documentation <code>spark.kubernetes.node.selector.[labelKey]</code></p>

Durgesh Choudhary
<p>Unfortunately this is not yet supported, but you can <a href="https://github.com/apache/spark/pull/25589/files" rel="nofollow noreferrer">follow the PR</a> which proposes that feature.</p>
