Only a small portion of the walls up to the second floor in the eastern wing survived, that were sold to the Jewish merchant Abraham Schlossberg around 1800, who incorporated them into his house. After the November uprising of 1831, Schlossberg's house had been bought and taken over by Imperial Russian Army, which had presence in arsenals nearby. As Vilnius fortress was established, the building became part of the fortress, which by itself was surrounded by the ditch. The Schlossberg's house in 1840 Vilnius map is named as barracks (). By the end of 19th century the fortress' ditch on former palace's site was covered with soil and turned into the city's park.