A century later, the space began a slow decline, which began innocently enough. On 20 October 1611, the Poor Clares nuns requested rock and stone from around the palace in order to repair their monastery. A similar request was made in 1666 by the Order of Friars Minor Capuchin to King Afonso VI (10th Duke of Braganza), to utilize rock from the interior walls of the palace to construct the Convent of Piedade. On January 31, the municipal chamber intervened over the destruction occurring to the Palace, and on 4 February inspected and evaluated its condition in order to inform the King of the need to conserve its structure. The local government purposed funding the friars, and providing the stone from the barbican in the Castle of Guimarães, in exchange for stone in the Palace. As conditions continued to deteriorate the municipal chamber requested the roaming magistrate determine who stole stone from near the gate of Santa Cruz. On 26 November 1672, Pedro Vaz de Sampaio, master mason, was requested to replace the gate, since it was already ruined. There was a profound degradation in the following centuries, with more and more of its stone taken for construction in the city and its re-purposing as a barracks in 1807. At that time, the inhabitable part of the Palace was retiled by the "almoxarife" Jerónimo de Matos Feijó and served as the barracks for the 20th Regimental Infantry.