"Little Voice" was released as the third and final single from the album on June 15, 2004, only in Australia. The song is a re-make of the 2000 song "The Little Voice" by Swedish recording artist Sahlene, written by Kara DioGuardi and Patrik Berger. The new version by Duff featured slightly different lyrics and was produced by Chico Bennett and DioGuardi. The song peaked at number twenty-nine in Australia. The music video for the song was taken from "The Girl Can Rock" Tour DVD.