Belatedly, Weld is trying to regain the moral high ground.
Weld wants to regain a sense of moral superiority after the fact.
Weld knows he's had the moral high ground this whole time, so now he's just trying not to lose it.