By the middle of the twentieth century, the chapel had succumbed to vandalism, having stood derelict for many years and in 1955, at the suggestion of Captain Ambrose de Lisle, it was dismantled and reassembled on its present site by the monks of Mount St Bernard. The semi-circular foundations of the original Chapel of Dolours can still be found on an outcrop not far from the Man Within Compass public House in Whitwick and further trace of its memory can be found in the naming of Temple Hill, a residential road developed close by, around the time of the chapel's removal.