But they might agree that slaves were sometimes happy despite their condition as slaves.
They might agree that despite their condition as slaves, the slaves were happy sometimes.
But, they can't agree that slaves were ever happy, due to their condition as slaves.