In Philadelphia, he lived at his wife's property, Fair Hill, near Germantown, which they modernized through their combined wealth. Meanwhile, he built an elegant mansion on Chestnut Street but never lived there as it was confiscated and turned into a hospital during his 1776–77 absence in Delaware. It then became the residence of the French ambassador and still later the home of his brother, Philemon Dickinson. Fair Hill was burned by the British during the Battle of Germantown. While in Philadelphia as State President, he lived at the confiscated mansion of Joseph Galloway at Sixth and Market Streets, now established as the State Presidential mansion.