title: My ANN is ignoring a class sometimes, possible solutions
body: <p>My ANN has two inputs and 16 outputs, sometimes it ignore some classes, even though my dataset has almost the same number of examples by class, as you can see in this image:<a href="https://i.stack.imgur.com/RqJqM.png" rel="nofollow noreferrer">the points in the 3rd row 4th column is simply ignored, it's very common even if i alter the number of hidden layers, hidden nodes or training examples.</a></p>
  
  <p>I trained the network a lot of times, and randomly it worked, as in this image:<a href="https://i.stack.imgur.com/3jPS1.png" rel="nofollow noreferrer">you can see here that each one of the 16 classes is being successfully classified.</a></p>
  
  <p>In both cases i am using one hidden layer with 32 hidden nodes, 10000 training examples, using stochastig gradient descent and k-fold validation. I couldn't implement regularization, but this problem doesn't look as overfitting.</p>
  
  <p>I just want to know if there is a way to force the neural network to use everyclass to classify, or if there is a problem with my network. I tried googling it but didn't find anything like it. Thanks, if any additional information is needed just ask it.</p>