Although Benjamin and Weiss continued to work together, their hits became less frequent and their working partnership ended in 1955. Benjamin then began working again with Sol Marcus, and the pair wrote "Lonely Man", recorded by Elvis Presley; and several songs recorded by Nina Simone, including "Don't Let Me Be Misunderstood". The song was co-credited to Benjamin, Marcus, and Gloria Caldwell, the wife of songwriter Horace Ott. It was recorded by Simone in 1964 and was later a hit for The Animals.