title: What are the signs to look out for to know that your neural network topology is inadequate
body: <p>I have been working on a neural network for the past few days and eventually came to the point where <code>1</code> was being represented by a <code>~0.45</code> value; to solve this I added another hidden layer neuron (on a hunch essentially) and the output became normal <code>~0.99.</code> </p>
  
  <p>Now this made me to think about what are the various signs that your network will give you to tell you that the number of weights/biases/neurons is inadequate?</p>
  
  <p>An additional related question is what are the signs of overfitting?</p>