Your reply reminds me of what Jesus also said to the Pharisees , on their excuse not to take care of their parents in their old age.

If you do not love your neighbors, then you do not really talk, or more important, really understand them. 

My next door neighbors had a big Hillary sign in their front yard. Yet we talk, visit, watch each other's house while away, etc.

In my humble opinion, yours doesn't sound like the love  Jesus, Paul & John noted in the New Testament, but selective love, based on externals.