His diverse educational experiences at public, private and Catholic schools allowed him an opportunity to compare all three systems as a lawmaker. Davis graduated from a North Hollywood military academy, the Harvard School for Boys (now part of Harvard-Westlake School). Davis's family was upper middle class and was led by his demanding mother. Davis was nicknamed Gray by his mother. His father, Joseph Graham Davis Sr., an advertising manager at Time Inc. and an alcoholic, was the son of businessman William Rhodes Davis.