A novel partial area index of receiver operating characteristic (ROC) curve

Tao Wu; Haibin Huang; Guangwei Du; Yiyong Sun

doi:10.1117/12.769888

6 March 2008 A novel partial area index of receiver operating characteristic (ROC) curve

Tao Wu, Haibin Huang, Guangwei Du, Yiyong Sun

Proceedings Volume 6917, Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment; 69170B (2008) https://doi.org/10.1117/12.769888
Event: Medical Imaging, 2008, San Diego, California, United States

Abstract

Appropriate validation of the segmentation algorithms is important for clinical acceptance of those methods. Receiver operating characteristic (ROC) analysis provides the most comprehensive description of the accuracy performance of image segmentation. Total area under an ROC curve (AUC) is widely used as an index of ROC analysis of performance test. However, a large part of the ROC curve is in the clinically irrelevant range. The total area can be misleading in some clinical situation. In this paper, we proposed a partial area index of ROC curves, which measures the segmentation performance in a clinically relevant range decided by learning from subjective ratings. The boundary of the range is defined by a linear cost function of false positive fraction (FPF) and true positive fraction (TPF). The cost factors of FPF and TPF are learned by maximizing the Kendall's coefficient of concordance (KCC) between the partial areas and the subjective ratings. Experiment results show that our method gives a large cost factor on FPF and a small cost factor on TPF on a tumor data set. This is consistent with the fact that a large FPF is generally more difficult to be accepted in tumor segmentation. Our method is able to determine the optimal range for partial area index of ROC analysis, and this partial area index is more appropriate than AUC for evaluating segmentation performance.

Citation Download Citation

Tao Wu, Haibin Huang, Guangwei Du, and Yiyong Sun "A novel partial area index of receiver operating characteristic (ROC) curve", Proc. SPIE 6917, Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment, 69170B (6 March 2008); https://doi.org/10.1117/12.769888

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available