Harvey and Ida were not the only members of the family to move to California. At his encouragement, his sister Sarah Luke, brother-in-law Elisha Luke, with her mother, Azubah, took the Atlantic & Pacific Railroad from Ogden to Los Angeles in November 1885 according to Adrian Weekly Press, November 13, 1885. The Lukes planned to stay only for the winter months, but Azaubah intended to remain with her son, Harvey, for the rest of her life. In February 1887 the Lukes and their daughter and son-in-law, Sam and Rosetta Young, with their young son, Almon, and Harvey's recently remarried brother Lewis, left Ogden to permanently settle in Los Angeles where Elisha would also become a real estate agent and land developer. The "Blissfield Advance" said in its Friday, February 18, 1887, edition that "Sam Young and wife and Elisha Luke and wife started for California last Thursday. Thus Ogden loses two of its staunch farmers, and the Prohibs, two valuable members."