title: Python Multiprocessing with Distributed Cluster
body: <p>I am looking for a python package that can do multiprocessing not just across different cores within a single computer, but also with a cluster distributed across multiple machines. There are a lot of different python packages for distributed computing, but most seem to require a change in code to run (for example a prefix indicating that the object is on a remote machine). Specifically, I would like something as close as possible to the multiprocessing <code>pool.map</code> function. So, for example, if on a single machine the script is:</p>
  
  <pre><code>from multiprocessing import Pool
  pool = Pool(processes = 8)
  resultlist = pool.map(function, arglist)
  </code></pre>
  
  <p>Then the pseudocode for a distributed cluster would be:</p>
  
  <pre><code>from distprocess import Connect, Pool, Cluster
  
  pool1 = Pool(processes = 8)
  c = Connect(ipaddress)
  pool2 = c.Pool(processes = 4)
  cluster = Cluster([pool1, pool2])
  resultlist = cluster.map(function, arglist)
  </code></pre>