title: Difference between MP and SP (or is it Core) in CUDA parallelism?
body: <h2>So, after reading some very useful posts, I came to the conclusion that,</h2>
  
  <ol>
  <li><p>Each Grid of Blocks executes on a single device. 
  (e.g Device has 9 MP)</p></li>
  <li><p>Each Block of Threads executes on a single MultiProcessor.
  (e.g 1 MP has 8 SP/Cores). </p></li>
  <li>Each Group of Threads (called warps) executes on a SP/Core.</li>
  </ol>
  
  <p>Now, if I assume that </p>
  
  <ol>
  <li>I have a total of 72 Cores (9*8) , </li>
  <li>I call kernel with 9 blocks and 8 threads,total 72 threads. </li>
  <li>All the 72 threads will run in parallel ?</li>
  </ol>
  
  <p>However, If I call more than that, then they will not run in parallel ? </p>