during the latter years of the roman empire , however , he began to hear whispers of an unnamed threat against his power , and rumors that a king would arise and cast him out of the world of men , barring his return with a sword that is not of this world .