By 1860, Smith was doing very well; he had moved to Leonard Street within the Fifth Ward and had a mansion built by white workmen. His total real property was worth $25,000. His household included a live-in servant, Catherine Grelis from Ireland. Listed as a separate household at his address were Sara D. Williams, 57, and Mary Hertell (should be Hewlitt, as above), 50. (These were likely the same Sara and Mary as in the 1850 census, although their ages did not change.) No one on this census page had a racial designation. By the conventions of the time, this means that they were classified as white by the census enumerator; totals of white persons only are given at the bottom of the page.