 In December 1862 he married Mary McCondach (d.1903) daughter of John McCondach, a builder.Their daughter Mary Lippe became Principal of Queen's Gate School in Aberdeen.His son Charles Lippe (1868-1919) became an advocate.