부인은 이종배이고 자녀로는 건축 공학 박사인 장남 임창일, 임창화, 미국에 체류 중인 임창범 등 3남이 있다.
His wife is Lee Jong-bae and his children are three sons: his eldest son Lim Chang-il, who is a doctor in architecture engineering, Lim Chang-hwa and Lim Chang-beom, who is staying in the US.