Whippingham is best known for its connections with Queen Victoria, especially St Mildred's Church, redesigned by Prince Albert. The village became the centre of the royal estate supporting Osborne House and Barton Manor. The farms, school, almshouses, forge and cottages were rebuilt when they became part of the Queen's estate and Prince Albert had a 'model farm' built at Barton. Queen Victoria took a close interest in 'her people' in Whippingham, providing for them in sickness and in health. It is also the home to The Folly Inn.