title: Apache Spark 2.4: Why is there "No Broadcast"?
body: <p>I have configured spark-submit with </p>
  
  <blockquote>
    <p>"--conf",
                  "spark.sql.autoBroadcastJoinThreshold=536870912",  512MB</p>
  </blockquote>
  
  <p>But the DAG is still not broadcasting the smaller side of the join.</p>
  
  <p>The code is a simple join. So I'm wondering what is wrong.</p>
  
  <p>The input are files of parquet, stored on S3.</p>
  
  <p>If more information is needed for further analyse, please let me know.</p>
  
  <p><a href="https://i.stack.imgur.com/2nbDI.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/2nbDI.png" alt="enter image description here"></a></p>