Research Repository

Estimating error rates in the classification of paired organs

Brenning, A and Lausen, B (2008) 'Estimating error rates in the classification of paired organs.' Statistics in Medicine, 27 (22). pp. 4515-4531. ISSN 0277-6715

Full text not available from this repository.


Clinical data from paired organs present a dependence structure that has to be considered when making statistical inference or evaluating classification rules with resampling-based techniques (bootstrap, cross-validation). We introduce a paired cross-validation approach for the estimation of misclassification error rates in the classification of data from paired organs. The dependence structure of the sample is honored by subject-level cross-validation. Theoretical considerations as well as a case?control study on glaucoma diagnosis and a simulation study show that the variance of the paired cross-validation estimator is considerably lower than in traditional cross-validation error estimation on one randomly selected eye per subject. The actual variance reduction is mainly controlled by the contribution of differential misclassification between both eyes to the overall error rate. By contrast, ?ad hoc? cross-validation ignoring the autocorrelation of paired organs leads to biased error estimates. Using the double-bagging technique, we also show that classification accuracy can be improved by using information from both eyes in training machine-learning classifiers. In glaucoma detection, the reduction in misclassification error rates by training data from both eyes is equivalent to an increase in the sample size by one-third to one-half, which is an important achievement in clinical studies.

Item Type: Article
Uncontrolled Keywords: paired organs; cross-validation; misclassification error rate; autocorrelation; double bagging
Subjects: Q Science > QA Mathematics
R Medicine > R Medicine (General)
Divisions: Faculty of Science and Health
Faculty of Science and Health > Mathematical Sciences, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 12 Dec 2011 11:32
Last Modified: 06 Jan 2022 13:24

Actions (login required)

View Item View Item