Luckily these women live in Canada, where they can make the choices they want to make, and have an ample support system, social, legal, etc.  If they chose to segregate themselves and not assimilate, they're mostly hurting themselves (and their children), and that is their right. Likewise, if they want to leave their religion and controlling husbands, there is a support structure to help them. 

I'm sorry, upsetting Canadians is not a criteria the government should use to tell individuals what clothes to wear. Would you like it if that was the reason used to suppress other rights? "Well a lot of Canadians are upset that you're meeting with Fred, Joe and Bob. I'm sorry, we have to revoke your freedom of association". Sound good to you?