run Spark-Submit on YARN but Imbalance (only 1 node is working) <p>i try to run <strong>Spark Apps</strong> on <strong>YARN-CLUSTER (2 Nodes)</strong> but it seems those 2 nodes are imbalance because only 1 node is working but another one is not.</p> <p>My Script :</p> <pre><code>spark-submit --class org.apache.spark.examples.SparkPi --master yarn-cluster --deploy-mode cluster --num-executors 2 --driver-memory 1G --executor-memory 1G --executor-cores 2 spark-examples-1.6.1-hadoop2.6.0.jar 1000 </code></pre> <p>I see one of my node is working but another is not, so this is imbalance :</p> <p><a href="https://i.stack.imgur.com/S8L57.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/S8L57.png" alt="enter image description here"></a> Note : in the left is <code>namenode</code>, and <code>datanode</code> is on the right...</p> <p>Any Idea ?</p>