Stewart was also responsible for converting the old hall in the west range to kitchens to service the tower. It was said that the building of the tower was a reaction to intimidation from the Earl of Huntly whom Stewart had excommunicated for failing to pay his taxes. During the mid 16th century, a walled garden to the south of the castle precinct, was established mainly to house an orchard. A deed was signed in the garden in 1556 indicating that it would have been a pleasant place to relax in. The household diet was further supplemented when a rabbit warren and a doocot were added in 1569. Bishop Patrick Hepburn (1538–73), the last Roman Catholic bishop at Spynie, installed wide-mouth gun-loops to boost the castle defences and enlarges some windows. He continued to live at Spynie for a period after the Reformation.