Willard and his wife Margaret had two daughters, Ann and Nancy. Willard was a photography enthusiast and hobbyist who occasionally sold his work. He died in Ann Arbor, Michigan, on May 7, 1974. Michigan holds a named professorship in his honor; the current Willard Professor of Chemistry is Robert T. Kennedy.