In 1540, both the castle and the town were heavily damaged by a fire. On William the Rich's orders, there came into being about the mid 16th century new building works. The market town was given a new town wall with four gates. In the northwest, the "Hohenhainer Tor" was built, in the northeast the "Weihertor", in the southeast the "Braastor" and in the southwest the "Schultor" ("Tor" means "gate"). However, owing to yet another town fire on 9 August 1666, the town was once again laid waste. Prince Johann Moritz von Nassau-Siegen built the town anew, using much the same layout, planned in 1540, as had stood before the fire. The castle, however, was not restored, and to this day, all that can be seen of it are a few wall remains.