Carroll was born in Dublin. He was 15 when he made his debut for Shelbourne. He played in the first ever Republic of Ireland U23 game in 1966. He then moved to Ipswich Town in July 1966 and played for the club at right full back for six seasons.