The castle and village then passed to Andrew Munro of Milntown. In the late 16th century the Munro of Pittonachy family held the estate of Pittonachy in the parish until Hugh Munro, III of Pittonachy (d.1670) sold it. It then became a property of the Mackenzies who renamed it Rosehaugh.
The castle and village were transferred to Andrew Munro of Milntown in the following years. The Munro family of Pittonachy held the estate until Hugh Munro III of Pittonachy (d.1670) sold it, after which it became a property of the Mackenzies who renamed it Rosehaugh.