Oh! This to me is one of your best. I makes me want to ask as well as to think and that is a good thing. Is it that "your fears" exclude those fears which you attribute to the "white folk" or is it that you see it as an "overlay" a scale of priority-intimates? Or, as I suspect, it  might apply also to a great many of the marginalized who do not have the oppertunities you have - I do not have the "freedom" that allows me to think beyond my fear. 
Maslov's hierarchy of "needs" applies here, I think, in a most incarnate way that goes beyond the theory to the side-walk.
I think I "get" the woman alone vulnerability, but I cannot but sense the additional vulnerability of a "black",  a Muslim, or other that further "intrigues" the sick or triggers the one on the edge. 
Even those of us who eschew racism carry the gene. Not only "white" for other but whatever is dominant for the other.
I really opine that we need to revisit "original sin". It is, i think, whatever in us that must be expunged.