Caesar recorded and performed with Albertina Walker, Cassietta George, Inez Andrews, Delores Washington, Josephine Howard, Eddie Williams and James Herndon while in the Caravans. Her biggest hit with the Caravans was the song "Sweeping Through the City" followed by "No Coward Soldier". After eight years with the Caravans, she decided to leave after being offered a solo recording contract with Hob Records. Her first LP on the Hob label was entitled "I'll Go", backed up by the Institutional Radio Choir and includes the classics "Oh Peter, Don't Be Afraid" and "Choose Ye This Day". Other hits soon followed with recordings such as "Satan, We're Gonna Tear Your Kingdom Down", "God's Not Dead, He's Yet Alive" and the classic "Don't Drive Your Mama Away". In 1971, Shirley won her first Grammy Award for her recording of "Put Your Hand in the Hand of the Man", and in 1975, her recording of the song "No Charge" became an instant hit and her first gold record. Despite this success, she wanted to reach larger audiences and felt this wasn't being achieved with Hob Records, so she decided not to renew her record contract with them, which ended that same year.