title: Validation loss increasing
body: <p>I am trying to solve dogs vs cats problem in kaggle with my numpy neural network.</p>
  
  <p>Validation loss</p>
  
  <p><img src="https://i.stack.imgur.com/WTYTk.png" alt="Validation loss graph"></p>
  
  <p>Training loss</p>
  
  <p><img src="https://i.stack.imgur.com/CGOFQ.png" alt="training loss graph"></p>
  
  <p>My training loss decreases well but the validation loss increases, so my model is definitely overfitting.
  I used two hidden layers with size 125, 50. I used learning rate of 0.075 ran the model with 600 iterations.</p>
  
  <p>I also tried using regularization with lambda = 0.01 or 0.03, but still didn't help.</p>
  
  <p>Any solutions to this problem?</p>