In the twelfth century, the site passed to the Knights Templar under the protection of Our Lady of Miracles. In the thirteenth century, it became a Franciscan friary. Tradition holds that St. Francis of Assisi himself visited here, in the company of twelve disciples, to found a small and humble community. As with the Moors and the Templars before them, the Franciscan friars established this location, from the beginning, as a stronghold, a place for resisting the depredations of pirates who continually roamed the coast. Pope Eugene IV granted indulgences to all who rendered aid to travelers seeking refuge at this site. Many of the buildings to house and support the Conventual Franciscans, more properly known as the Order of Friars Minor Conventual, were constructed during the first part of the fifteenth century. The noble of the region, Don Juan Alfonso de Guzman El Bueno, the 1st Duke of Medina Sidonia (1410-1468), as well as local commoners, all collaborated in the construction projects.