Weaver was born on January 19, 1926 in Pittsburgh, Pennsylvania. He was raised in Pittsburgh, Pennsylvania. Weaver studied at Peabody High School. He was married to Sylvia Short from 1953 until they divorced in 1979. Then he married Rochelle Oliver in 1997. Weaver had two children with Short.