Gladys Knight & the Pips which became another top 40 hit in early 1962. After a string of single releases on Fury Records Langston George left the group in 1962. The group's success was halted by Gladys Knight's sudden departure in 1962 to start a family with husband Jimmy Newman, a musician. Knight gave birth to the couple's son James Gaston Newman III in August. A daughter, Kenya Maria Newman, was born in November 1963. During this period, the Pips kept performing and recording to little fanfare and eventually each Pip took odd jobs while Gladys Knight began performing solo with Jimmy Newman being her
Gladys Knight & the Pips now opening for top recording acts such as Jackie Wilson and Sam Cooke. By 1959, Brunswick dropped the group and both Brenda Knight and Eleanor Guest left the group to begin families. They were replaced by another cousin, Edward Patten, and a friend, Langston George. Patten and George were involved in another group before joining the Pips. In 1961, they recorded their version of Johnny Otis' "Every Beat of My Heart". Because the group was without a record label, a local Atlanta label, Huntom Records, pushed the single and got a distribution deal with Vee-Jay Records to release the single.