His father died in 1619, when he was 9 years old. He became "Viscount Thurles". His mother took him to England where his grandfather (Walter Butler, 11th Earl of Ormond) made him go to a Catholic school. James I was King at the time. James I was a Protestant, and wanted to make sure that James would also be a Protestant. This would give him power in Ireland once James Butler went back to Thurles. James I placed James Butler under the care of archbishop George Abbot. When he was fifteen he went to live with his grandfather at Drury-lane." 