Due to the fact that the output of the hidden layer a1 is also the input of the output layer with the output a2, the hidden layer can be, in general, analyzed also as a single layer network with  S1 inputs, S2 neurons and S2  ×S1 weight matrix