In 1840, Beaufort bought the house at 22 Arlington Street in St. James's, a district of the City of Westminster in central London from John Pratt, 1st Marquess Camden and proceeded to expend enormous sums refurbishing the interior of the house. He renamed the house after his title and during his residency it was known as "Beaufort House." He hired architect Owen Jones, who had studied the Alhambra to embellish the interiors. Beaufort sold the house a year before he died to William Hamilton, 11th Duke of Hamilton.