Baldwin began work with his older sons on the Middlesex Canal in 1794 and after nine years, the canal began service in 1803. He later worked on Boston's fortifications. His son Cyrus continued his father's work on the Middlesex Canal as an agent for the canal company. His son Benjamin worked on the Boston Mill Dam for before an early death at age 43.