Towards the end of 1979, Frith relocated to New York City, where he immediately hooked up with the local avant-garde/downtown music scene. The impact on him was uplifting: "... New York was a profoundly liberating experience for me; for the first time I felt that I could be myself and not try to live up to what I imagined people were thinking about me." Frith met and began recording with a number of musicians and groups, including Henry Kaiser ("With Friends Like These", "Who Needs Enemies?"), Bob Ostertag ("Getting a Head", "Voice of America"), Tom Cora, Eugene Chadbourne, Zeena Parkins, Ikue Mori, the Residents, Material, the Golden Palominos, and Curlew. He spent some 14 years in New York, during which time he joined a few bands, including John Zorn's Naked City (in which Frith played bass) and French Frith Kaiser Thompson (consisting of John French, Frith, Henry Kaiser and Richard Thompson). Frith also started three bands himself, namely Massacre, Skeleton Crew, and Keep the Dog.