Harvey and Ida moved from Topeka to Los Angeles in early 1883 and tradition says that Harvey rode in the baggage car with two of his prized horses. In Los Angeles Harvey formed the real estate company of Wilcox and Shaw. Harvey and Ida had one child, a son named Harry, who died in 1886 at the age of 18 months. Family tradition says that to console themselves over the death of their baby, Harvey and Ida would take buggy rides to the beautiful canyons west of Los Angeles. Harvey purchased one of their favorite areas for $150 per acre. It was in an agricultural area of fig and apricot orchards. Harvey tried his hand at raising fruit, but failed and decided to subdivide the land, selling lots for $1,000 each. His wife named the tract "Hollywood." On February 1, 1887, Harvey filed a plat of the subdivision with the Los Angeles County Recorder's office. He would also develop residential property, "The University Tract," surrounding the newly built University of Southern California in 1887.