After some uprisings the castle became too unsafe, and in the course of an extension of the town, together with the construction of a new double-ring of town walls, the Wittelsbach dukes once again chose the very northeastern corner as the construction site for a replacement ducal residence. Consequently, as it was newly erected, the castle was called "Neuveste", new fortress. Over the course of centuries, the Neuveste would eventually develop into what is nowadays the Munich Residenz. When Duke Sigismund lived in the Alter Hof at the end of the fifteenth century and made further structural alterations to it, including painting in the courtyard with lozenge-shaped decoration, the actual residence was already the Neuveste. In the first half of the 16th century, Duke William IV finally transferred the residence permanently to the Neuveste. Thus from the 16th century onwards, the Alter Hof was only seat of several governmental departments including the stewardship.