On Gilbert's death, the castle passed to his widow Joan and around this time it was referred to as "Castrum Rubeum", Latin for "the Red Castle", probably after the colour of the Red sandstone defences. Gilbert's son, also named Gilbert, inherited the property in 1307. He died at the Battle of Bannockburn in 1314, triggering an uprising of the native Welsh in the region. Castell Coch was probably destroyed by the rebels in July 1314, and possibly slighted to put it beyond any further use; it was not rebuilt and the site was abandoned.