Performance Metrics for BERT NLP in Classifying 30-Day Documented Goals-of-Care Discussions at Note and Patient Levels in a 159-Patient, 2480-Note Internal Validation Sample
Abbreviations: AUC, area under the receiver operating characteristic curve; AUPRC, area under the precision-recall curve; NLP, natural language processing; NPV, negative predictive value; PPV, positive predictive value.Performance metrics are shown at observed discrimination thresholds with sensitivities closest to prespecified values of 70%, 80%, and 90%.