The early history of Clifton Maybank (sometimes named Clifton Maubank or Clifton House) is obscure. The Horsey family of Horsey near Bridgwater in Somerset held properties in and around Clifton Maybank during the fifteenth century. When John Horsey (1479–1531) died, he was buried at Yetminster parish church, near Clifton Maybank. His son, Sir John Horsey substantially increased the family's wealth and power. Little is known of the Horsey family house at Clifton Maybank at this time, but it is known that the poet Sir Thomas Wyatt died while staying at the house in 1542. Sir John died four years later in 1546. Soon after this his oldest son, Sir John Horsey, made Clifton Maybank his principal residence and began a major and expensive rebuilding process on the house, using the local Ham stone. It has been described as "one of the most spectacular of the group of contemporary houses in the district, which included Barrington, Melbury, and Montacute." The Horsey family fortunes entered a period of slow decline, and in 1786 much of the house was dismantled and sold - one main front of the building being transferred to Montacute House and the early 17th century lodge was removed in 1800 to Hinton St George.