From this marriage, seven children were born including the firstborn James Barry, 4th Earl of Barrymore.
Secondly, he married Martha Lawrence, daughter of Henry Lawrence and Amy Peyton, which produced Laurence Barry, 3rd Earl of Barrymore and Theodora.