<p>Yes, that is how current neural networks work. The only exception are some state of the art networks such as <a href="https://arxiv.org/abs/1711.11503" rel="nofollow noreferrer">CNNs with Adaptive Inference Graphs</a>.</p>
When making prediction with a trained neural net, does input have to run through all layers?
<p>When you have an input that you want to make a prediction on, does the input have to be run through the entire neural net?</p>