Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter August 18, 2010

Statistical methods for assessment of added usefulness of new biomarkers

  • Michael J. Pencina , Ralph B. D'Agostino and Ramachandran S. Vasan


The discovery and development of new biomarkers continues to be an exciting and promising field. Improvement in prediction of risk of developing disease is one of the key motivations in these pursuits. Appropriate statistical measures are necessary for drawing meaningful conclusions about the clinical usefulness of these new markers. In this review, we present several novel metrics proposed to serve this purpose. We use reclassification tables constructed on the basis of clinically meaningful disease risk categories to discuss the concepts of calibration, risk separation, risk discrimination, and risk classification accuracy. We discuss the notion that the net reclassification improvement (NRI) is a simple yet informative way to summarize information contained in risk reclassification tables. In the absence of meaningful risk categories, we suggest a ‘category-less’ version of the NRI and integrated discrimination improvement as metrics to summarize the incremental value of new biomarkers. We also suggest that predictiveness curves be preferred to receiver operating characteristic curves as visual descriptors of a statistical model's ability to separate predicted probabilities of disease events. Reporting of standard metrics, including measures of relative risk and the c statistic, is still recommended. These concepts are illustrated with a risk prediction example using data from the Framingham Heart Study.

Clin Chem Lab Med 2010;48:1703–11.

Corresponding authors: Michael J. Pencina, PhD, Department of Biostatistics, Boston University, Framingham Heart Study, Harvard Clinical Research Institute, 111 Cummington St., Boston, MA 02215, USA Phone: +1 617-358-3386, Fax: +1 617-353-4767, Ramachandran S. Vasan, MD, DM, FACC, Boston University School of Medicine, Framingham Heart Study, 73 Mount Wayte Avenue, Suite 2, Framingham, MA 01702-5803, USA Phone: +1 508-935-3450,

Received: 2010-2-11
Accepted: 2010-6-18
Published Online: 2010-08-18
Published in Print: 2010-12-01

©2010 by Walter de Gruyter Berlin New York

Downloaded on 25.9.2023 from
Scroll to top button