title: parallel for loop python
body: <p>I would like to parallelize a for loop in python.</p>
  
  <p>The loop gets fed by a generator and I expect 1 billion items.</p>
  
  <p>It turned out, that joblib has a giant memory leak</p>
  
  <pre><code>Parallel(n_jobs=num_cores)(delayed(testtm)(tm) for tm in powerset(all_turns))
  </code></pre>
  
  <p>I do not want to store data in this loop, just print sometimes something out, but the main thread grows in seconds to 1 GB size.</p>
  
  <p>Are there any other frameworks for a large number of iterations?</p>