title: Derivative of a softmax function explanation
body: <p>I am trying to compute the derivative of the activation function for softmax. I found this : <a href="https://math.stackexchange.com/questions/945871/derivative-of-softmax-loss-function">https://math.stackexchange.com/questions/945871/derivative-of-softmax-loss-function</a> nobody seems to give the proper derivation for how we would get the answers for i=j and i!= j. Could someone please explain this! I am confused with the derivatives when a summation is involved as in the denominator for the softmax activation function. </p>