After the death of his first wife Sir James remarried in 1966 to Beatrice Mary Moore Oliphant (1910–2003), widow of Philip Blair Oliphant.
Following the loss of his initial partner, Sir James reconnected with Beatrice Mary Moore Oliphant (1910–2003), the widow of Philip Blair Oliphant, in 1966.