title: combining two neural networks into one
body: <p>im trying to make a multithreaded extension to the <a href="http://leenissen.dk/fann/wp/" rel="nofollow">FANN</a> library. Because FANN is not <a href="http://leenissen.dk/fann/forum/viewtopic.php?t=149" rel="nofollow">threadsafe</a> i will do this:</p>
  
  <ol>
  <li>divide the training set in <em>N</em> pieces (<em>N</em> is the number of CPUs)</li>
  <li>copy the <em>ANN</em> to <em>N</em> copies</li>
  <li>train each on his piece for 1 epoch</li>
  <li>combine the <em>ANN</em> weights from the <em>N</em> copies</li>
  <li>if not end conditions goto 2.</li>
  </ol>
  
  <p>My question is: how can I combine the neural network weights into one. Can I just make mean from all?</p>