<p>The paper talks about pre-activation Resnet-101. Pre-activation architecture is where they use BN- Relu- Conv. It has been shown to improve performance of Resnets in the paper Identity Mappings in Deep Residual Networks-<a href="https://arxiv.org/pdf/1603.05027.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/1603.05027.pdf</a></p>
Why does the activation function come before convolution in DenseNet?
<p>In the DenseNet paper, it says:</p>

<blockquote>
  <p>each “conv” layer shown in the table corresponds the sequence BN-ReLU-Conv.</p>
</blockquote>

<p>Why is it that the relu activation comes before the convolution? Thanks in advance!</p>