Joyce actually lived in the tower very briefly, and it is the location for the first chapter of Ulysses.
The first chapter of Ulysses takes place in a tower.
Joyce never lived in the tower he used in the first chapter of Ulysses.