His personality, externally at least, was cold, dignified, and grave. Some of those who knew him best say that he was in reality warm-hearted but the characteristics that made an impression on every one were his reserve and his austerity; in general he was an object of respect rather than of affection; he had none of the weaknesses that make men lovable. As deeply religious as any of his Puritan ancestors, he was most broadly tolerant of the beliefs of others. His conception of civic duty was Roman, but he was ever willing to oppose even the State in defending what he regarded as the constitutional and legal rights of the individual. He was frugal to such a degree that on one occasion when traveling as governor with his staff, instead of partaking of a sumptuous dinner in a dining car specially provided for them, he rode in a coach and ate a sandwich which he had brought from home. With this frugality he combined a generosity even more marked. Part of his life was lived in the days of high hats. Such hats, when they became old, were usually donated to the missionaries. To quote from one who for many years served with Judge Baldwin on the committee of a missionary society, ""He used to turn in his old high hat at the shop for fifteen cents, but he would give $1,500 to the committee for missions."" He was unyielding where a principle was involved; but in matters of mere policy he had the remarkable ability, once he was outvoted, to make the policy of the majority his own even though he had strenuously opposed it.