After Walpole left office, he was made a Privy Councillor on 13 July 1742. He served as Captain of the Honourable Corps of Gentlemen Pensioners from 1742 to 1744. He was appointed Treasurer to the Prince of Wales when the unfortunate Frederick was already at the end of his life, had fallen out with his hated father, George II he was banned from Kensington Palace. Bathurst was responsible for the Prince's chaotic finances in his extravagant home in Leicester Square. He had moved several times to many different mansions with a large family. His eldest son who became George III was a Tory by inclination and farmer by occupation, but in his accession to throne Bathurst was removed from office. However he secured an annual pension from the new king of £2,000 on the heavily taxed Irish establishment.