Since the metrics in Evaluation of binary classifiers are not evaluating the calibration, scoring rules which can do so are needed.
The current methods used to evaluate binary classifiers are not sufficient because they do not account for calibration. To address this, new scoring rules that can calibrate the evaluation process are needed.