title: Out of Memory; BERT
body: <p>I am new in this area and trying to learn through the below Github link.
  However, I have encountered a runtime error. Despite tweaking the batch size and gradient accumulation to smaller values, and clearing the cache, the runtime error persists.</p>
  
  <p>Can anyone share any insight on this? Thanks very much.</p>
  
  <p><a href="https://github.com/nlptown/nlp-notebooks/blob/master/Text%20classification%20with%20BERT%20in%20PyTorch.ipynb" rel="nofollow noreferrer">https://github.com/nlptown/nlp-notebooks/blob/master/Text%20classification%20with%20BERT%20in%20PyTorch.ipynb</a></p>
  
  <blockquote>
    <p>RuntimeError: CUDA out of memory. Tried to allocate 1024.00 KiB (GPU 0; 4.00 GiB total capacity; 3.09 GiB already allocated; 528.00 KiB free; 32.48 MiB cached)</p>
  </blockquote>