title: Test loss seems to be increased after 20 epochs
body: <p>I trained MNIST using 8 layers fully connected neural network (tensorflow) and got my result as shown below. May I know why the test loss increased after the 20 epoch? Is that due to overfitting? These are the network configurations:</p>
  
  <pre><code>L1: 1600 neurons
  L2: 800 neurons
  L3: 400 neurons
  L4: 200 neurons
  L5: 100 neurons
  L6: 60 neurons
  L7: 30 neurons
  L8: 10 neurons
  Optimizer: Adam (learning_rate = 0.001)
  activation function: Relu
  batch size: 64
  dropout rate: 0.7
  epoch:100
  </code></pre>
  
  <p><a href="https://i.stack.imgur.com/sIb28.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/sIb28.png" alt="enter image description here"></a></p>