I think the reference was along the lines of John 13:34-35  

"I give you a new commandment:* love one another. As I have loved you, so you also should love one another.t 

This is how all will know that you are my disciples, if you have love for one another." 

And no, He's not just talking about those who show up at mass, see e.g., the parable of the good Samaritan. Luke 10:25-37.