title: Apache Solr - Physical memory growing too fast upon dataimport
body: <p>I am running the dataimport command nightly (127.0.0.1:8983/solr/dataimport?command=full-import) </p>
  
  <p>After a few days, I look at my solr admin panel and the physical memory is over 4gb.  If I delete the index (delete all files in the data directory) and then run the dataimport, the physical memory goes down to 1.1gb.  Without deleting it, the physical memory grows at a very fast rate. </p>
  
  <p>Do I need additional parameters like clean=true?  I want to run a cron task that is essentially the same as deleting the data directory, then running the full import to keep my physical memory as low as possible. </p>
  
  <p>I am using the default cache settings for solr 4.0.</p>
  
  <pre><code>&lt;query&gt;
  
  &lt;maxBooleanClauses&gt;1024&lt;/maxBooleanClauses&gt;
  
  &lt;filterCache class="solr.FastLRUCache"
               size="512"
               initialSize="512"
               autowarmCount="0"/&gt;
  
  
  &lt;queryResultCache class="solr.LRUCache"
                   size="512"
                   initialSize="512"
                   autowarmCount="0"/&gt;
  
  
  &lt;documentCache class="solr.LRUCache"
                 size="512"
                 initialSize="512"
                 autowarmCount="0"/&gt;
  
  &lt;enableLazyFieldLoading&gt;true&lt;/enableLazyFieldLoading&gt;
  
  &lt;queryResultWindowSize&gt;20&lt;/queryResultWindowSize&gt;
  &lt;queryResultMaxDocsCached&gt;200&lt;/queryResultMaxDocsCached&gt;
  
  
  &lt;listener event="newSearcher" class="solr.QuerySenderListener"&gt;
    &lt;arr name="queries"&gt;
      &lt;!--
         &lt;lst&gt;&lt;str name="q"&gt;solr&lt;/str&gt;&lt;str name="sort"&gt;price asc&lt;/str&gt;&lt;/lst&gt;
         &lt;lst&gt;&lt;str name="q"&gt;rocks&lt;/str&gt;&lt;str name="sort"&gt;weight asc&lt;/str&gt;&lt;/lst&gt;
        --&gt;
    &lt;/arr&gt;
  &lt;/listener&gt;
  &lt;listener event="firstSearcher" class="solr.QuerySenderListener"&gt;
    &lt;arr name="queries"&gt;
      &lt;lst&gt;
        &lt;str name="q"&gt;static firstSearcher warming in solrconfig.xml&lt;/str&gt;
      &lt;/lst&gt;
    &lt;/arr&gt;
  &lt;/listener&gt;
  
  &lt;useColdSearcher&gt;false&lt;/useColdSearcher&gt;
  
  &lt;maxWarmingSearchers&gt;2&lt;/maxWarmingSearchers&gt;
  
  &lt;/query&gt;
  </code></pre>