his brother patrick had tended to hire impoverished but well-schooled young men to help in his household-they 'd been terrible footmen but had regularly discussed mathematics and classical thought with the brothers , which had been the point .