<p>I think what you're looking for is in <em><a href="https://arxiv.org/abs/1803.08494" rel="nofollow noreferrer">Group Normalization</a>, by Yuxin Wu, Kaiming He IJCV'20</em>.</p>
<p>Especially <strong>Fig. 2</strong>:</p>
<p><a href="https://i.stack.imgur.com/sQR7B.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/sQR7B.png" alt="enter image description here" /></a></p>
Batch normalization vs layer normalization
<p>Please illustrate batch normalisation and layer normalisation with a clear notation involving tensors. Also comment on when each one is required/recommended.</p>