It was designed by the architect Sir Robert Smirke. Building was started in 1817. In 1820 they ran out of money. It was not finished until 1861 when it was opened to the public. There were also plans for a statue of Wellesley on a horse in front of it. This was never built.