On 5 May 1838, Livermore married the widow Maria Josefa de Jesus Higuera Molina (1815–1879), daughter of Jose Loreto Higuera, grantee of Rancho Los Tularcitos, at the Mission San José. Josefa's grandfather, Ygnacio Higuera had been a member of Gaspar de Portolà's Expedition Sancta in 1769 and had accompanied Juan Bautista de Anza in his expedition of 1775–76. They first settled in the Sunol Valley, but later moved to Las Positas, as he was making regular trips there to manage his rancho. Initially an adobe structure built by Livermore and Amador served as their house on the rancho. In 1850, a wooden two-story house was shipped around Cape Horn and became the Livermores' new home. Later the adobe structure was rented to Nathaniel Greene Patterson who used it as a small hotel, the first place of entertainment in the valley.