You're misunderstanding me. 

Let me be very clear: Since the civil rights movement it is illegal for the government or businesses to discriminate based on race. This was a huge step forward, though there have been civil rights cases brought forward. I am assume we both understand this and agree.

What this means though is that black families, before the civil rights movement, were the victims of racist policies and business practices. The impact of this still has effects today.

So when someone says "black people are poor because of their own choices" that misses the bigger picture. The reasons for this can often be attributed (overall) to racist policies in the past. On top of that, just because the government cannot have racist laws does not mean people in the government cannot be racist. Which is at the heart of the police brutality issue. 

To tie this back to the main point: white privilege means you don't have the burden of current and past racism to deal with. Rich or poor.