Goldwyn was born in Los Angeles, California. He was the son of actress Frances Howard and the pioneer motion picture mogul Samuel Goldwyn. He attended Fountain Valley School in Colorado Springs, Colorado and the University of Virginia in Charlottesville, Virginia. He served in World War II. He was married twice and had six children including Tony Goldwyn and John Goldwyn.