When his father Charles Carpenter died in 1882, Edward inherited the sum of £6,000 (£500,000 in 2020). This enabled Carpenter to quit his lectureship to seek the simpler life, first on a small holding at Totley near Sheffield with Albert Ferneyhough, a scythe-maker, and his family in 1880; Albert and Edward became lovers and in 1883 moved to Millthorpe, Derbyshire together with Albert's family, where Carpenter built a large new house with outbuildings in 1883 constructed of local gritstone with a slate roof, in the style of the seventeenth century. There they had a small market garden and made and sold leather sandals, based on the design of sandals sent to him from India by Harold Cox on Carpenter's request.