In the 1750s William Baker had leased land from the family to lay out Orchard and Portman Streets, and the north side of Oxford Street. Henry William Portman, a descendant of Sir William, continued the development in 1764 with the creation of Portman Square, with buildings by James Wyatt, Robert Adam and James 'Athenian' Stuart, including Montagu House, built in the north-west corner for the famed literary hostess Elizabeth Montagu and later used by the Portman family as their London town house.