The museum's collection originated from the artifacts and archival materials originally held at Cartier Square Military Museum in 1880; including an assortment of weapons; a bell from , the flagship for Admiral Charles Saunders during the 1759 siege of Quebec; and the colours for the Royal Highland Emigrants, and various units from the War of 1812. The collection grew in size during the First World War, with materials from the war transported back to Canada. Following the end of World War II in Europe, the museum dispatched its first collections acquisition team to the Netherlands and Allied-occupied Germany to acquire a large number of German military equipment. During the Cold War, the museum's collection continued to expand with the Canadian Armed Forces transferring its obsolete equipment, as well as examples of enemy equipment to the museum. During the 1990s, the museum also began to acquire a number of materials as gifts from several post-Soviet states.