In 1966 and 1967, he published a series of books under the Caterpillar Books imprint. These include titles by Aimé Césaire (in Eshleman's co-translation with Denis Kelly), Cid Corman, Paul Blackburn, Frank Sampari, David Antin, D. Alexander, Robert Vas Dias, Jackson Mac Low, and himself. In 1967, he founded and beginning editing Caterpillar magazine, which he would publish quarterly through 1970, and periodically thereafter, through 1973. The magazine was supported by grants from the Council of Literary Magazines and the National Translation Center as well as sales, advertisement, and donations. Caterpillar was of major significance for poets writing in the postmodern tradition during those years.