[36] show that with careful initialization, residual networks can be trained as stable as those with normalization.
we also show the possibility of estimating RMS on a subset of the summed inputs, maintaining this invariance property.