Yarrow was born on May 31, 1938 in New York City, New York to a Ukrainian-Jewish family. He studied at High School of Music and Art and at Cornell University. Yarrow is married to Mary Beth McCarthy (niece of Eugene McCarthy). They have two children.