and after the victory of the lords of the west those of the evil men who were not destroyed fled back into the east , where many of their race were still wandering in the unharvested lands , wild and lawless , refusing alike the summons of the valar and of morgoth .