The moated manor house belonged to the Rainsford family from 1562 until the English Civil War. Around the turn of the seventeenth century, during the tenure of Sir Henry Rainsford and his wife Anne, the house was visited by well-known poets, including Michael Drayton, Ben Jonson and William Shakespeare. Drayton viewed Anne as his muse, writing poems such as ""Idea. The Shepheards Garland as Poemes Lyrick and pastorall"" in her honour. Drayton also eulogized Sir Henry Rainsford in his poem "Upon the Death of his Incomparable Friend, Sir Henry Raynsford Of Clifford." The estate was sequestered during the English Civil War for taking the side of King Charles, but the owners compounded before selling it. Subsequent generations of Rainsfords were to be found in London, rather than Clifford Chambers.