title: The spark driver has stopped unexpectedly and is restarting. Your notebook will be automatically reattached
body: <p>I try to analyze a dataset of 500Mb in Databricks. These data are stored in Excel file. The first thing that I did was to install Spark Excel package <code>com.crealytics.spark.excel</code> from Maven (last version - 0.11.1).</p>
  
  <p>These are the parameters of the cluster:</p>
  
  <p><a href="https://i.stack.imgur.com/0YZIa.png" rel="noreferrer"><img src="https://i.stack.imgur.com/0YZIa.png" alt=""></a></p>
  
  <p>Then I executed the following code in Scala notebook:</p>
  
  <pre><code>val df_spc = spark.read
            .format("com.crealytics.spark.excel")
            .option("useHeader", "true")
            .load("dbfs:/FileStore/tables/test.xlsx")
  </code></pre>
  
  <p>But I got error about the Java heap size and then I get another error "java.io.IOException: GC overhead limit exceeded". Then I executed this code again and got another error after 5 minutes running:</p>
  
  <blockquote>
    <p>The spark driver has stopped unexpectedly and is restarting. Your
    notebook will be automatically reattached.</p>
  </blockquote>
  
  <p>I do not understand why it happens. In fact the data set is quite small for the distributed computing and the cluster size should be ok to process these data. What should I check to solve it?</p>