Many black families find themselves in poorer neighborhoods because they did not receive the same opportunities as whites did due to explicitly racist policies. When racist policies were in place a poor white family was afforded greater privilege than a poor black family was. Hence the white privilege. This has a compounding effect: a white family is allowed a loan which allows them to buy a house, hence increasing their wealth. This increases their property value which improves the school in their neighborhood. Now their children have a better education which affords them better opportunities, etc.

https://en.wikipedia.org/wiki/Redlining
https://en.wikipedia.org/wiki/Housing_discrimination_(United_States)

So tell me how whites, today, do not benefit from racial policies in the past and I'll give up the idea that white privilege is a thing. Until then, I'll continue on working to bridge the opportunity gap and understand that through no fault of my own I have things a little easier.