The property saw two major expansions, with the first series of expansions occurring in the 1840s. Several additions were made to the house, possibly because there had been a fire (this is difficult to confirm). These changes included the enlargement of the drawing room; the elimination of three bedrooms to create a large second-floor assembly room; and an addition on the west end to house an office. William Boulton, who was mayor of Toronto four times and a Member of Parliament, might have needed such a space. The front hall was also enlarged and a new central staircase installed. The painted glass window depicting the family crest was also added. This crest is a visual play on the name Boulton, as it shows a barrel pierced by an arrow, or "bolt", with a hogshead of wine or "tun". The family motto — ""Dux vitae ratio"" ("The guide to life is reason") — rests below the crest, always reminding the Boultons of their British ancestry. William, the secretary of the Turf Club, built St. Leger Race Course to the north.