Birmingham, under mayor A. O. Lane, had purchased land on the south of Red Mountain between 1889 and 1896. The former Red Mountain Cemetery, a pauper's cemetery was part of the parcel that was dedicated as a city park in 1934. The Works Progress Administration built a fish hatchery and a number of pavilions from the Hartselle sandstone quarried out of the mountain within the park's borders. The hatchery was fed by a natural spring and provided stock for recreational lakes in the region until the zoo took over the park.