Chatham Manor the Custis slaves as executor after his in-laws' deaths. The plantation included an orchard, mill, and a race track where Fitzhugh's horses vied with those of other planters for prize money. Fizhugh named the mansion after the British parliamentarian William Pitt, 1st Earl of Chatham, who championed many of the opinions held by American colonists prior to the Revolutionary War. Flanking the main house were dozens of supporting structures: slave quarters, a dairy, ice house, barns, stables. Down on the river were fish traps. Fitzhugh sold the Chatham plantation to Major Churchill Jones, who had served under Col. William Washington
John Pitt, 2nd Earl of Chatham recalled in disgrace. His appearance before a parliamentary enquiry did him no favours, particularly when it emerged that he had presented the King with a private memorandum which ought to have gone to the Secretary of State for War first. Spencer Perceval's government withdrew its support from Chatham and he was forced to resign from the Ordnance in May 1810. Chatham's political and military reputation was ruined. A poem circulated making fun of his inactivity and the lack of co-operation between the army and navy: Chatham did not serve actively again, but was promoted to full General in January 1812.