title: Memory error solutions in Python
body: <p>I'm loading a lot of objects with dicts containing large string values. Overall, the program exceeds 2GB and crashes. It doesn't exceed by much, but I could well have even larger data later.</p>
  
  <p>It seems Python 32bit is unable to access more memory. I suppose for the future I need some object database system which is able to handle large data and still not be too slow (i.e. store in DB or harddrive, but keep some in memory for speed). For performance I don't want to keep the data in MySQL only but rather have some transparent mechanism which keeps as much as possible in memory.</p>
  
  <p>Can you think of a good way to deal with so much data in objects?</p>