Sherman was born on September 18, 1805 in Newton, Connecticut. He was a brick manufacturer and made the bricks for Archibald Clybourne's mansion. In July 1835, he was elected a village trustee. In 1837, he opened the City Hotel, later the Sherman House. He continued to work as a contractor and builder, eventually serving as mayor of Chicago three times.