Both the ruined nunnery and the castle (associated with the Archbishops of York, and in particular with John Williams) are contrasted in the poem with Appleton House.
In the poem, the ruined nunnery and the castle, linked to the Archbishops of York and specifically John Williams, are juxtaposed against Appleton House.