Chu was born in St. Louis, Missouri. He has ancestry from Taicang, Jiangsu. He attended and graduated from Garden City High School. He received both a B.A. in mathematics and a B.S. in physics in 1970 from the University of Rochester. He went on to earn his Ph.D. in physics from the University of California, Berkeley, in 1976.