Robert Palmer married Susan Eileen Thatcher in 1971. They had two children together, James and Jane. They divorced in 1999. In 1993, Palmer moved from the Bahamas to Lugano, Switzerland. He thought the islands were overrun with drugs and guns and were no longer safe. Palmer's companion at the time of his death was Mary Ambrose.