Benjamin Grayson constructed Grayson's Tavern in Danville sometime around 1785. The asymmetrical, ell-shaped building faces south onto Walnut Street with a front entrance on the south and a side entrance on the west, which opens onto Constitution Square. The Mary Akin Memorial Herb Garden, located behind Grayson's Tavern, features a variety of herbs that were commonly cultivated in the area during the late 18th and early 19th century, including chives, fennel, honeysuckle, lavender, rosemary, sage, and thyme. The garden is maintained by the Garden Club of Danville and named for one of its long-time members.