In 1902, Baker left his practice at the Cape in the hands of his partner and went to live in Johannesburg, where he built Stonehouse. On a visit to the United Kingdom in 1904, he married his cousin, Florence Edmeades, daughter of Gen. Henry Edmund Edmeades, bringing her back to Johannesburg, where two sons, the first of four children, were born. Baker quickly became noted for his work, and was commissioned by a number of the "Randlords" (the wealthy mining magnates of Johannesburg) to design houses, particularly in the suburbs of Parktown and Westcliff. He also designed commercial premises and public buildings.