Card is the son of Willard Richards Card and Peggy Jane (maiden name Park). He is the third of six children. Song-writer Arlen Card is his younger brother. Card was born in Richland, Washington. He grew up in Santa Clara, California, Mesa, Arizona, and Orem, Utah. He went on a mission for the Church of Jesus Christ of Latter Day Saints in Brazil. Card graduated from Brigham Young University (BYU) and the University of Utah. He also spent a year in a Ph.D program at the University of Notre Dame. 