In 1548 another castle with tower was completed by George Gordon, 4th Earl of Huntly (1514–1562). He was constable of the castle until 1562. The castle was later taken by the Clan Munro and Clan Fraser, who supported Mary Queen of Scots during the Siege of Inverness (1562). Robert Mor Munro, 15th Baron of Foulis, chief of the Clan Munro, was a staunch supporter and faithful friend of Mary Queen of Scots and was consequently treated favourably by her son James VI.