Since the metrics in Evaluation of binary classifiers are not evaluating the calibration, scoring rules which can do so are needed.
Metrics in binary classifier evaluation should be calibrated, but scoring rules that can do so are needed.