<p>I ran the below command to run the spark job on kubernetes.</p>
<pre><code>./bin/spark-submit \
        --master k8s://https://192.168.0.91:6443 \
        --deploy-mode cluster \
        --name spark-steve-test \
        --class org.apache.spark.examples.Spark \
        --conf spark.executor.instances=2 \
        --conf spark.kubernetes.namespace=spark \
        --conf spark.kubernetes.authenticate.driver.serviceAccountName=spark \
        --conf spark.kubernetes.container.image=sclee01/spark:v2.3.0 \
        local:///opt/spark/examples/jars/spark-examples_2.12-3.0.1.jar
</code></pre>
<p>However, I got the below messages that it seemed that the pod was not created due to some reasons.</p>
<pre><code>20/10/22 12:00:36 INFO LoggingPodStatusWatcherImpl: Application status for spark-6a79e5b39a84403bb83dbf69ca20a02c (phase: Pending)
20/10/22 12:00:37 INFO LoggingPodStatusWatcherImpl: State changed, new state: 
         pod name: spark-steve-test-01-734603754e4038ed-driver
         namespace: spark
         labels: spark-app-selector -&gt; spark-6a79e5b39a84403bb83dbf69ca20a02c, spark-role -&gt; driver
         pod uid: 5afec1f7-b1cd-4bac-a6c2-be239e0efc30
         creation time: 2020-10-22T03:00:34Z
         service account name: spark
         volumes: spark-local-dir-1, spark-conf-volume, spark-token-bdwh9
         node name: bistelresearchdev-sm
         start time: 2020-10-22T03:00:34Z
         phase: Running
         container status: 
                 container name: spark-kubernetes-driver
                 container image: sclee01/spark:v2.3.0
                 container state: running
                 container started at: 2020-10-22T03:00:37Z
20/10/22 12:00:37 INFO LoggingPodStatusWatcherImpl: Application status for spark-6a79e5b39a84403bb83dbf69ca20a02c (phase: Running)
20/10/22 12:00:38 INFO LoggingPodStatusWatcherImpl: Application status for spark-6a79e5b39a84403bb83dbf69ca20a02c (phase: Running)
20/10/22 12:00:39 INFO LoggingPodStatusWatcherImpl: Application status for spark-6a79e5b39a84403bb83dbf69ca20a02c (phase: Running)
20/10/22 12:00:40 INFO LoggingPodStatusWatcherImpl: Application status for spark-6a79e5b39a84403bb83dbf69ca20a02c (phase: Running)
20/10/22 12:00:41 INFO LoggingPodStatusWatcherImpl: State changed, new state: 
         pod name: spark-steve-test-01-734603754e4038ed-driver
         namespace: spark
         labels: spark-app-selector -&gt; spark-6a79e5b39a84403bb83dbf69ca20a02c, spark-role -&gt; driver
         pod uid: 5afec1f7-b1cd-4bac-a6c2-be239e0efc30
         creation time: 2020-10-22T03:00:34Z
         service account name: spark
         volumes: spark-local-dir-1, spark-conf-volume, spark-token-bdwh9
         node name: bistelresearchdev-sm
         start time: 2020-10-22T03:00:34Z
         phase: Failed
         container status: 
                 container name: spark-kubernetes-driver
                 container image: sclee01/spark:v2.3.0
                 container state: terminated
                 container started at: 2020-10-22T03:00:37Z
                 container finished at: 2020-10-22T03:00:40Z
                 exit code: 1
                 termination reason: Error
20/10/22 12:00:41 INFO LoggingPodStatusWatcherImpl: Application status for spark-6a79e5b39a84403bb83dbf69ca20a02c (phase: Failed)
20/10/22 12:00:41 INFO LoggingPodStatusWatcherImpl: Container final statuses:


         container name: spark-kubernetes-driver
         container image: sclee01/spark:v2.3.0
         container state: terminated
         container started at: 2020-10-22T03:00:37Z
         container finished at: 2020-10-22T03:00:40Z
         exit code: 1
         termination reason: Error
20/10/22 12:00:41 INFO LoggingPodStatusWatcherImpl: Application spark-steve-test-01 with submission ID spark:spark-steve-test-01-734603754e4038ed-driver finished
20/10/22 12:00:41 INFO ShutdownHookManager: Shutdown hook called
20/10/22 12:00:41 INFO ShutdownHookManager: Deleting directory /tmp/spark-2e4e5f9a-c54d-4790-b4cb-f9b6cd1e2105
</code></pre>
<p>The only I can see is that the <code>error</code> and I could not see the detailed reason for it.
I ran the below command but it doesn't give me any further information.</p>
<pre><code>bistel@BISTelResearchDev-NN:~/user/sclee/project/spark/spark-3.0.1-bin-hadoop2.7$  kubectl logs -p spark-steve-test-01-734603754e4038ed-driver
Error from server (NotFound): pods &quot;spark-steve-test-01-734603754e4038ed-driver&quot; not found
bistel@BISTelResearchDev-NN:~/user/sclee/project/spark/spark-3.0.1-bin-hadoop2.7$ 
</code></pre>
<p>Any help will be apppreciated.</p>
<p>Thanks.</p>

<p>For more <a href="https://kubernetes.io/docs/tasks/debug-application-cluster/debug-application/#debugging-pods" rel="nofollow noreferrer">detailed information</a> you can use <code>kubectl describe pod &lt;pod-name&gt;</code>.
It will print a detailed description of the selected resources, including related resources such as events or controllers.</p>
<p>You can also use <code>kubectl get event | grep pod/&lt;pod-name&gt;</code> - it will show events only for selected pod.</p>
