Kennedy was the husband of Rose Fitzgerald Kennedy. Their children included President John F. Kennedy (1917–1963), Senator Robert F. Kennedy (1925–1968), and longtime Senator Ted Kennedy (1932–2009). He served as the first chairman of the Maritime Commission from 1936 through 1938.