In 1353 however Charles granted the "Vogtei" (advocacy, or right of protection) to the Counts of Helfenstein. From then until the early 16th century the abbey was caught up in continuing political disruption between the surrounding states and great families. At various times the monastery or the "Vogtei" (or both) was given, generally along with Heidenheim, to the Counts of Helfenstein or the rulers of Württemberg or Austria, and different emperors alternately granted it away in exchange for favours or mortgaged it, and then restored it to independence. On a couple of occasions it was given to the city of Ulm. It was put under Imperial protection on several occasions, and at some point during this period was granted "Reichsfreiheit" as an Imperial abbey in an effort to shield it.