Charlton was born in Linton, Victoria. He grew up in Newcastle, New South Wales. He married Martha Rollings in 1889. He had two children. He died on 8 December 1948 in Lambton, New South Wales, at the age of 82.