His older brother was Thomas Taylour, 1st Marquess of Headfort and his younger brothers were Robert Taylour and Clotworthy Rowley, 1st Baron Langford.
Thomas Taylour was the older brother with the title of 1st Marquess of Headfort. His younger brothers were named Robert Taylour and Clotworthy Rowley, who held the title of 1st Baron Langford.