In April 1841 he wrote "Business is going on prosperously, and I have a comfortable home at my own fire side and a good wife, who studies my interest in every respect". Ann was very supportive of her husband and was able to keep his shop running during any forced absence, jury duty for instance. Their first son, William, was born on 19 November 1841, followed by Harry in February 1843, and Elizabeth in November 1844. In December 1845 they lost a baby, (Eulalia), so William decided to move his family away from the unsanitary conditions of the city. He purchased 16 acres (6.4 ha) of land at Glen Osmond, "just 3 miles from the Adelaide city centre", and in the winter of 1846 built a house, later to be called "Benacre", moving the family there before the onset of the next summer. He commuted daily to his business in the city. They lost another baby, (James), in 1848, but Edward was born in 1849.