Edwards was born in Marksville, Louisiana. He studied at Louisiana State University. Edwards was married to Elaine Schwartzenburg from 1949 until they divorced in 1989. Then he was married to Candace Picou from 1994 until they divorced in 2004. Then he married his current wife, Trina Grimes Scott in 2011. Edwards has four children with Elaine and one with Trina.