Colville was the son of General the Honourable Sir Charles Colville and the grandson of John Colville, 8th Lord Colville of Culross.
Colville was the progeny of General the Honourable Sir Charles Colville and a member of the noble Colville family, which included John Colville, 8th Lord Colville of Culross.