Freed was born May 13, 1932 in Chicago, Illinois, the only son of Jeanne Greene and David J. Freed, an attorney; the couple later divorced. Freed maintained a relationship with his biological father throughout his life. His mother remarried Arthur Malsin, a merchant by trade. At age 4, Freed moved with his mother and stepfather to Eagle River, Wisconsin. Three years later, Freed’s mother and stepfather moved again, to Alexandria, Louisiana, The family expanded; Freed is the eldest of his four half-siblings Lynnel Hope, Anne, Paulette, and Byron. From 1939-1949, he was educated at West End Grammar School, Bolton High School, St. John’s Military Academy in Delafield, WI, and Louisiana College.