 There was a fairly strong feeling amongst the townspeople of Mittagong to have all the cottages centralised on "Southwood Estate".This led to the buying of "Rotherwood", a property on which the Rotherwood cottage was built.The original house on the property was used as the Hospital Cottage until its closure in 1976.