In 1828 his wife and son came to the colony and arguments between them culminated in his attempted suicide. There had been rumours about Eliza's conduct with the colony's Attorney General, her chaperone, during the journey from England. She may have also been angered that Savery's letters to her had exaggerated his position in the colony. Soon after, he was imprisoned for debt and Eliza took their son back England within three months. This was the last they were to see of each other.