Main Article Content

Abstract

Background. Postoperative delirium is common in intensive care and linked to adverse functional and cognitive outcomes. Valid risk prediction requires transparent predictor timing, outcome definition, validation design, and cohort independence.


Objective. To reproduce and extend a published postoperative delirium model, quantify record overlap between its public development and validation worksheets, and determine what level of validation the data support.


Methods. We analyzed a public prospective-cohort workbook (300 development and 100 designated-validation records). The published five-predictor equation, a refitted logistic model, and a ten-predictor penalized logistic model were compared by repeated nested 10-fold cross-validation. Discrimination, Brier score, and calibration were assessed with bootstrap intervals. Exact cross-sheet matches required agreement on ten predictors, the Intensive Care Delirium Screening Checklist score, and the delirium label. Designated-worksheet and non-overlap analyses were sensitivity analyses.


Results. Delirium occurred in 82/300 development (27.3%) and 29/100 designated-validation records (29.0%). The area under the receiver operating characteristic curve (AUROC) was 0.838 (95% bootstrap interval 0.782–0.886) for the refitted five-predictor model and 0.840 (0.785–0.888) for the penalized model; Brier scores were 0.132 and 0.134, and calibration slopes 0.751 and 1.061. Seventy-six of 100 validation records matched development records exactly. Designated-worksheet AUROC was high (0.957–0.961) but not independent. The 24-record non-overlap subset had 17 events and seven non-events, so estimates were imprecise.


Conclusion. The parsimonious model showed reproducible internal discrimination, and penalization added no material gain. Because record independence is not supported, the validation worksheet does not establish transportability. Prospective evaluation in an independent cohort is required before clinical use.

Keywords

Calibration Delirium Intensive care unit Prediction model Validation

Article Details

How to Cite
Chandra, K., & Maulana, D. H. (2026). Dataset Overlap Constrains Validation of a Postoperative Delirium Model at Intensive Care Unit Admission. Scientia Psychiatrica, 7(3), 171-180. https://doi.org/10.37275/scipsy.v7i3.219