title: Tensorflow - How access loss value for each example in batch?
body: <p>During training I periodically evaluate my tensorflow network using a modified version of the tensorflow example do_eval() function. My evaluation loss is:</p>
  
  <pre><code>evalLoss = tf.nn.l2_loss(tf.sub(prediction, truthValues_placeholder))
  </code></pre>
  
  <p>This produces a single scalar loss value. I feed batch truth values in the placeholder via feed_dict.</p>
  
  <ol>
  <li>Is that single scalar the loss value for the entire batch?</li>
  <li>If so, is it the sum of the losses for each example in the batch?</li>
  <li>If so, how does one access the loss for each example in a batch? I want to see the individual examples for debugging.</li>
  </ol>
  
  <p>Thanks in advance.</p>