Lord Balcarres married, at St Margaret's, Westminster, on 25 January 1900, Constance Lilian Pelly, daughter of Sir Henry Pelly, 3rd Baronet. They had eight children, two sons and six daughters. One daughter, Lady Mary Lilian Lindsay (1910–2004), married Reginald Manningham-Buller, 1st Viscount Dilhorne, Lord Chancellor of Great Britain from 1962 to 1964, whose daughter was Dame Eliza Manningham-Buller, Director-General of MI5 from 2002 to 2007. Their younger son the Hon. James Lindsay was Member of Parliament for Devon North. Lord and Lady Crawford's fifth daughter Lady Katharine Constance Lindsay married Sir Godfrey Nicholson, 1st Baronet, and was the mother of Baroness Nicholson of Winterbourne.