the hotels on the waterfront were brilliant white with racing green shutters , many with buttresses and towers built on top for the town could only grow upwards here as the cliffs pushed it into the sea .