Well you’re wrong and here’s why:
There is no recent history of white people being enslaved. So no white person is going to be offended. 
For the good professor to not realize that his remark, coming from a white person and directed to a black person, would be offensive, is evidence of privilege and racism.