anytime she tried to bring it up , they quickly dismissed the subject as just vicious gossip , which was ironic since so many of the villagers relished recounting all of the duke 's lady loves that had prowled the village streets over time .