If you have joint legal custody, your ex can challenge your move to Canada.  However, it sounds like your ex doesn't really want anything to do with your son, and vice versa. \n\nI would advise you to seek out an attorney and get a good, solid legal opinion on this before doing anything.