- Book Chapter
3
- 10.1002/9781118445112.stat08078
Calibration of Prognostic Risk Scores
- Aug 14, 2018
- Wiley StatsRef: Statistics Reference Online
- Ben Van Calster + 1 more +1
Abstract Prognostic risk scores provide individualized risk estimates for an outcome (“event”) based on included covariates. Calibration indicates the extent to which risk estimates are reliable. We review four increasingly stringent definitions of calibration: mean, weak, moderate, and strong calibration. The latter requires that the risk model perfectly corresponds to the observed proportions for every single covariate pattern, and hence can be regarded as impossible to achieve in practice (“utopic”). We present an overview of methods to assess calibration, including goodness‐of‐fit tests, summary measures, and graphical procedures. We show that estimation and visualization of the degree of (mis)calibration is essential, whereas testing is problematic. We illustrate the methods with a case study on the prediction of the histology of retroperitoneal lymph nodes following chemotherapy for testicular cancer.
Read more