His son and two daughters sold the castle to Sir William Wentworth of Gawthorpe Hall in 1600 to clear debts; this is probably when Harewood Castle ceased to be a main residence.
The sale of Harewood Castle in 1600 by his son and daughters to Sir William Wentworth of Gawthorpe Hall is likely when it ceased to be their primary residence.