Albert was born on April 22, 1906 in Rock Island, Illinois, but was raised in Minneapolis, Minnesota. Albert studied at the University of Minnesota. He was married to Margo Albert from 1945 until her death in 1985. They had two children. Albert died on May 26, 2005 in Pacific Palisades, California from Pneumonia caused by Alzheimer's disease, aged 99.