Construction on Sulphur Spring Park was scheduled to commence in late November 1884. A brick-and-cement dyke was built between Cherry and Summer Streets (Fourth and Fifth Avenue North) to hold back the spring water. The low land was filled in to bring it level with Cherry and Summer. The old bath houses were demolished and replaced with new ones that utilized a steam pump to draw up water. The grounds were graded, leveled, sowed with grass, and enclosed by a fence. In addition to the grandstand, a dancing hall and refreshment booths were also built. During construction, workers unearthed artifacts including bowls, shells, a flint chisel, and human skeletons believed to belong Native American Mound Builders.