Lone Justice began as part of the L.A. cowpunk scene of the 1980s, inspired by Hedgecock and McKee's shared affection for rockabilly and country music. The group started out as a strict cover band, but after the additions of bassist David Harrington and drummer Don Willens, they began to compose their own material. Marvin Etzioni was initially brought in as producer, arranger and songwriter for the band, but ended up replacing Harrington as bassist in 1983. By 1984, Don Heffington had replaced Willens as drummer. Their early sound was a fusion of country music and punk rock with rockabilly elements, but by the time of their first album, the band had begun to incorporate elements of roots rock and singer-songwriter styles. Benmont Tench of Tom Petty and the Heartbreakers was a frequent guest musician at their live shows. The band earned early support from Dolly Parton, who attended one of their club shows and later recalled McKee as "The greatest girl singer any band could ever have."