Magee came from a sporting family, and he and two of his brothers were capped at international level. Louis Magee was the most notable player and was capped for the Ireland national rugby union team on 27 occasions. Joseph Magee also played for Ireland, winning only two caps, but continued his rugby career as an international referee. Magee never represented Ireland, but in 1896 joined his brother Louis on the British Isles tour of South Africa. There is general confusion in many publications regarding which brother went on the South Africa tour, with many archives stating Joseph travelled with Louis; but it has now been accepted that Magee undertook the trip.