in ybor , they called the house el alcalde de la mansion-the mayor 's mansion-but joe would n't learn of the nickname for at least a year because the voices in the street never rose high enough for him to hear them distinctly .