Irranca-Davies was born in Gowerton, Swansea. He was named after his step great-uncle, Ifor Davies, also a Welsh Labour politician. On marriage, he and wife Joanna Irranca both changed their surnames to Irranca-Davies.