In 1587, the castle was plundered by Dutch soldiers. There are also reports from the early 17th century outlining the damage to, and decline of the castle. An occupation in 1605 by southern European soldiers caused significant damage. The soldiers removed the lead bracing in the main tower leaving it in a perilous state of near collapse. In 1607, funds were raised by the local archiepiscopal commission, and restoration work carried out in 1612, where 77 windows were installed to make the castle more livable. However, that same year, a severe storm tore the chimneys and roofs off some of the buildings leaving the castle in a nearly ruined state. In 1633, during Thirty Years' War, the castle was occupied by Swedish troops as a defensible position, and by 1656, the castle fell into a state of near uninhabitability. Despite the crumbling walls, the castle was still seen an important military site due to its high position and relative ease of defense.