Kaye has achieved critical acclaim as one of the best session bassists of all time. Michael Molenda, writing in "Bass Player" magazine, said that Kaye could listen to other musicians and instantly work out a memorable bass line that would fit with the song, such as her additions to Sonny & Cher's "The Beat Goes On". Paul McCartney has said that his bass playing on The Beatles' "Sgt Pepper's Lonely Hearts Club Band" was inspired by her work on "Pet Sounds". Alison Richter, writing in "Bass Guitar" magazine, has called Kaye the "First Lady" of bass playing, adding "her style and influence are in your musical DNA."