Byrne's live cabaret, "Caught in the Act Again", commenced during mid-1999, it included both show tunes and some original material. The first half was "a little too low-key, mostly because the songs all have a similar, slow, acid-jazzy tempo" according to Fiona Scott-Norman of "The Age". She was backed by John McAll on piano and Don Hirini as backing vocalist; she also co-wrote some material, including "I Don't Make the Rules", with Hirini. "Caught in the Act Again" earned a Green Room Award nomination for Best Cabaret Performance and Best Musical Arrangement.