He married Alice Strelley and had four sons and three daughters. His eldest son was Anthony who died before him in 1587 and thus he was succeeded by his son Sir John Byron (died 1623). One of his daughters was married to Sir Thomas Hutchinson of Owthorpe, Nottinghamshire. Their daughter Margaret Hutchinson is an ancestor of U.S. President Andrew Jackson.