Williams first came to public notice in 1789 for "Barddoniaeth Dafydd ab Gwilym", a collection of the poetry of the 14th-century Dafydd ap Gwilym. Included were a large number of hitherto unknown poems by Dafydd that he claimed to have found; these are regarded as Williams's first forgeries. His success led him to return to London in 1791, where he founded the Gorsedd, a community of Welsh bards, at a ceremony on 21 June 1792 at Primrose Hill. He organised the occasion according to what he claimed were ancient Druidic rites. In 1794 he published some of his own poetry, which was later collected in a two-volume "Poems, Lyric and Pastoral". Essentially his only genuine work, it proved quite popular.