After taking office, Madison sought to appoint Gallatin as Secretary of State, which was generally seen as the most prestigious cabinet position. Opposition from the Senate convinced Madison to retain Gallatin as Secretary of the Treasury, and Robert Smith instead received the appointment as Secretary of State. Gallatin was deeply displeased by the appointment of Smith, and he was frequently criticized by Smith's brother, Senator Samuel Smith, as well as journalist William Duane of the influential "Philadelphia Aurora". He considered resigning from government service, but Madison convinced him to stay on as a key cabinet official and adviser.