Fellow Jewish-Montrealer Leonard Cohen was an admirer who cited Klein as an influence and had written a couple of poems as well as a song, "To a Teacher," in Klein's memory. Mordecai Richler is said to have used Klein as a model for the character L. B. Berger in "Solomon Gursky Was Here" (1989). He is honoured posthumously through the A. M. Klein Prize for Poetry, presented by the Quebec Writers' Federation. A play inspired by the poems and life of Klein was produced by Tableau D'Hôte Theatre and presented at the Segal Centre for Performing Arts in Montréal in February 2009.