In addition to these generalizations, there is good reason to suspect the results to extend to much broader class of models and optimization procedures.
a wealth of recent literature suggests that the mean field theory governing the wide network limit of fully-connected models [32,33] extends naturally to residual networks [35], CNNs [34], RNNs [39], batch normalization [40], and to broad architectures [37].