Payne was born on January 29, 1935, in Manhattan, New York City, to Elizabeth (née Searle) and Edward Benedict Payne. His mother was a music teacher and his father an electrical engineer.
Payne's birthplace and family background were marked by his mother's involvement in music education and his father's work as an electrical engineer.