It is thought that the castle passed into the hands of the McCarthy who controlled that area, then passed into the hands of the Hurley. In 1654, the Hurley lost the castle, which passed to the Crofts.
The castle is thought to have been seized by the McCarthy clan who dominated the area, only to be acquired by the Hurley family. However, in 1654, the Hurleys relinquished their hold on the castle, which was subsequently inherited by the Crofts.