Miller was born in Buenos Aires, Argentina, to a Danish father and a American mother. She was raised in the United States (in New Orleans, Fresno, Long Island, New York and San Francisco) and in Copenhagen in Denmark. Miller studied at San Francisco State College. She was married to William Schuyler from 1953 until his death in 2013. They had two daughters.