Frith formed Keep the Dog in 1989, a sextet and review band for performing selections of his extensive repertoire of compositions from the previous 15 years. The lineup was Frith (guitar, violin, bass guitar), René Lussier (guitar, bass guitar), Jean Derome (winds), Zeena Parkins (piano, synthesizer, harp, accordion), Bob Ostertag (sampling keyboard), and Kevin Norton (drums, percussion). Later Charles Hayward replaced Norton on drums. The group existed until mid-1991, performing live in Europe, North America and the former Soviet Union. A double CD, "That House We Lived In", from their final performances in Austria, Germany and Italy in May and June 1991, was released in 2003.