Lord Seafield was noted for tree-planting. Sir William Fraser wrote that:He was known as the largest planter of trees in Britain ... the annals of the Highland and Agricultural Society of Scotland recording that in 1847, that at that date 31,686,482 young trees, Scotch firs, larch, and hardwoods, had been planted under the Earl's direction over an area of 8223 acres... For these plantations, which were effected in the districts of Cullen, Moray, Strathspey, and Glen Urquhart, the Highland Society awarded to the Earl their gold medal. Living mainly in Cullen House, his taste for "ornamental landscape" resulted in remodelling of the house, grounds and nearby town, as well as "improvements" to other towns within his estates.