Irving was born to a working-class family in Keinton Mandeville in the county of Somerset. W.H. Davies, the celebrated poet, was a cousin. Irving spent his childhood living with his aunt, Mrs Penberthy, at Halsetown in Cornwall. He competed in a recitation contest at a local Methodist chapel where he was beaten by William Curnow, later the editor of "The Sydney Morning Herald". He attended City Commercial School for two years before going to work in the office of a law firm at age 13. When he saw Samuel Phelps play Hamlet soon after this, he sought lessons, letters of introduction, and work in a theatre in Sunderland in 1856, labouring against great odds until his 1871 success in "The Bells" in London set him apart from all the rest.