Sir Thomas Lucy tore down an earlier structure to make way for the present house in 1558. He was a man of wealth. He entertained Queen Elizabeth I at breakfast in 1572 as she made her way to Kenilworth. Lucy is better known for having fined the young William Shakespeare over a poaching incident in 1583. This incident prompted Shakespeare to flee Warwickshire for London.