The Tourbillon Castle became the main residence of the Bishops of Sion from the time of its construction until Guichard Tavelli, who preferred the Soie Castle. After Tavelli bought Majorie Castle in 1373, Tourbillon became a temporary residence for the bishop but retained its military importance. On several occasions, Tourbillon was taken by force by Tavelli's enemies. On two occasions, the inhabitants of Sion laid siege to the castle and the bishop was forced to call for help from Amadeus VI of Savoy, who sent negotiators who managed to reach agreements with the people of Sion. A third conflict, this time with a nobleman from the Upper Valais named Pierre de la Tour, broke out in 1352 when he wanted to emancipate the bishop. Pierre de la Tour's men set fire to a castle in Sierre and were arrested while trying to inflict the same fate on the castle of Tourbillon. In exchange for the help of Amadeus VI, Tavelli offered the office of bailiff to the Count of Savoy. The latter appointed a vice-bailiff to administer the region and installed him in Tourbillon.