On his return to civilian life, he met David Sutch and formed the Savages with amongst others Nicky Hopkins who lived locally. Screaming Lord Sutch & the Savages toured the UK and became known for their unique British rock and roll shows. The bulk of the band members, including Little, left in 1962 to join the Cyril Davies All Stars, and recorded a single "Country Line Special", an instrumental track which influenced Keith Richards and Ray Davies. He also played a few gigs with the young Rolling Stones and was asked by Brian Jones to join permanently before they hired Charlie Watts as their official drummer in January 1963. In 1998, during their European tour, he was invited as an official guest backstage at one of their Paris concerts.