The building is really a series of additions to an original structure, although the overall effect is one of elegance and superb proportion.
The original structure was built on to.
The additions to the original structure were clumsy and awkward.