Seymour and Catherine moved into the castle and brought with them ladies to attend on the Queen Dowager, as well as gentlemen of the household and Yeomen of the guard. The castle was then home to over 100 people. Another famous figure who came to live in the castle of Lady Jane Grey, who was a ward of Seymour's, as well as the young Elizabeth I of England.