A Novel "maximizing Kappa" Approach for Assessing the Ability of a Diagnostic Marker and Its Optimal Cutoff Value

Chia Hao Chang*, Jen Tsung Yang, Ming Hsueh Lee

*Corresponding author for this work

Research output: Contribution to journalJournal Article peer-review

3 Scopus citations

Abstract

Threshold-dependent accuracy measures such as true classification rates in ordered multiple-class (k > 3) receiver operating characteristic (ROC) hyper-surfaces have recently been used to assist with medical decision making. However, based on low power performance in some circumstances, we construct a new method that relies on the kappa coefficient to solve such diagnostic problems. Under the approach proposed in the present article, the statistics depend strongly on the cutoff threshold, which can be chosen to maximize the kappa statistics of true disease status and of the new biomarker. The Monte Carlo simulation results confirm the effectiveness of the proposed method in terms of its predictive power. The proposed design is then compared with the volume under the ROC hyper-surface by applying it to intracerebral hemorrhagic patients classified into five stroke classes using the National Institutes of Health Stroke Scale.

Original languageEnglish
Pages (from-to)1005-1019
Number of pages15
JournalJournal of Biopharmaceutical Statistics
Volume25
Issue number5
DOIs
StatePublished - 03 09 2015
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2015 Chang Gung University of Science and Technology.

Keywords

  • Diagnostic testing cutoff values
  • Maximize kappa
  • Theory of extremes
  • Volume under the ROC hyper-surface

Fingerprint

Dive into the research topics of 'A Novel "maximizing Kappa" Approach for Assessing the Ability of a Diagnostic Marker and Its Optimal Cutoff Value'. Together they form a unique fingerprint.

Cite this