Coffee moved from England to New York City in 1816, where he became famous as a sculptor for American historical figures such as James Madison and Thomas Jefferson. He also made the mouldings for Jefferson's house and for the University of Virginia.