Hill bought three lots on Summit Avenue in 1882, during an era when wealthy citizens were scrambling to build fashionable homes in the neighborhood. The street offered a commanding view of downtown St. Paul and the Mississippi River area, making it a highly desirable location. The family previously lived in the Lowertown area in St. Paul, near Ninth and Canada streets. As new warehouses and railroad tracks crowded the Lowertown residential area, and as Hill's collection of paintings and sculpture overflowed the house, the Hill family thought it was desirable to move. Hill also realized that recent improvements in home technology, such as electric lighting, plumbing, ventilation, and fireproofing, could be incorporated into a new home. Moreover, since Hill was becoming a socially prominent person in the community, a new home would stand as a tribute to his status as the "Empire Builder".