As long as a person's character or public image is not a qualification for the position, then there is no reason to act before a thorough investigation can be conducted by the proper authority.
Sexual assault and other sexual abuses are mostly unrelated to authority. These actions have no bearing on one's ability to run a business or a hold a political position.