The Douglas family built the first Douglas Castle, which was constructed of either wood or stone, sometime before 1288. In 1307, during the Wars of Scottish Independence the castle was captured and garrisoned by the English under Lord Clifford. Sir James Douglas, companion of Robert the Bruce successfully recaptured his family seat by storming the castle on Palm Sunday, while the garrison were at chapel. He had the garrison killed and thrown into a cellar, before the structure was burned. The event has become known as "Douglas' larder".