After World War 1 started and relations with the United Kingdom and Germany started being bad, the building would become empty. It would only be in 1920 that the United Kingdom would start to use it again, as the war had ended. However, the building would return to being empty after World War 2 started, as United Kingdom-Germany relations became bad again. After allied bombing on Germany, the building would become very damaged. After the end of the war, it was decided that the building would be completely destroyed in 1950. The United Kingdom still owned the land though.