from there , the conversation drifted to inaccurate descriptions of the duke 's lavish estates , to the horses in his famous stables , and inevitably returned to more tales of his mistresses and conquests .