The diocesan and secular territory were already separated in 1151. However, the bishops held no secular rights in the town of Havelberg itself, which was enfeoffed to the Brandenburg margraves. A charter issued by Emperor Frederick Barbarossa to declare the residence an episcopal city was never carried out, and in the following centuries, the Havelberg bishops gradually moved their residence to their "Amt" Wittstock about to the northeast. In 1383 the Holy Blood of Wilsnack became a famous pilgrimage site, while Dietrich Man was bishop. From the 14th century onwards, the Havelberg bishops also used Plattenburg Castle as a summer residence.