title: What hardware setup is required to use MPI with CUDA?
body: <p>I am new to MPI. I want use CUDA with MPI.   I am having three PCs, each having one GPU,  which I want to use for doing some simple processing (matrix multiplication).</p>
  
  <p>But I am not sure what hardware setup is required to use MPI with CUDA?
  Please enlighten me. </p>
  
  <p><strong>Update</strong>
  I am asking this as many a place mentions clusters with infiniband. I do not have such a set up. I only have ordinary Lan that we have in offices. 
   And above all the basic idea is to have a feel of how MPI and CUDA work together and do small small tests runs--irrespective of the performance.      </p>