In the following year he entered Parliament as member for Morpeth, but for a considerable period he took scarcely any part in the debates. In 1800 he inherited a fortune from Dr Gem. On the retirement of Pitt in 1801 he resigned office, and after contesting Dover unsuccessfully he withdrew for a time into private life. Having in 1804 been chosen to represent Liskeard, he was appointed secretary of the treasury on the restoration of the Pitt ministry, holding office till the dissolution of the ministry after the death of Pitt in January 1806.