At the beginning of the 20th century the Playfair family employed the architect Robert Weir Schulz to remodel the north front of the house and to design new gardens. After the Playfairs left West Green House five years later, the new owner, Evelyn, Duchess of Wellington continued to improve the gardens. The Duchess and her friend Yvonne Fitzroy occupied the house and garden for many years. Victor Sassoon bought the house and allowed the Duchess and her friend to live in house until the Duchess's death in 1939 and Fitzroy's death in 1971.