In 1600 Petr Vok of Rožmberk bequeathed the castle and its estates to his nephew Johann Zrinski of Seryn (1565–1612), son to Nikola Šubić Zrinski. Zrinski rebuilt the Lower castle in Renaissance style. When he died in 1612, the estates were inherited by the Švamberks, relatives of the Rožmberks. But they soon lost the castle because all their estates were confiscated after the Battle of White Mountain by Emperor Ferdinand II, who gave it to the commander of the Imperial army, Charles Bonaventure de Longueval, Count of Bucquoy, who played an important role in the suppression of the rebellion of the Czech Estates. The Buquoys, whose main residence was in Nové Hrady, repaired and altered their family seat (1840–57), remodelling the building in the style of Romantic Neo-Gothic, and keeping it until 1945 when it was nationalised after the end of World War II.