While stages 2 and 3 of our reference ConvNet can be perfectly split into 8—8 blocks and thus no performance is lost, Stage 1 has only 3 input channels and can load the core only with ..............=3/8.
stages with a small number of input or output channels also perform much less operations and efficiency in these cases is thus not that important.