Difference of two dependent sensitivities and specificities: Comparison of various approaches

TY - JOUR

T1 - Difference of two dependent sensitivities and specificities: Comparison of various approaches

AU - Wenzel, Daniela

AU - Zapf, Antonia

N1 - © 2013 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

PY - 2013/9

Y1 - 2013/9

N2 - In diagnostic studies, a new diagnostic test is often compared with a standard test and both tests are applied on the same patients, called paired design. The true disease state is in general given by the so-called gold standard (most reliable method for classification), which has to be known for all patients. The benefit of the new diagnostic test can be evaluated by sensitivity and specificity, which are in fact proportions. This means, for the comparison of two diagnostic tests, confidence intervals for the difference of the dependent estimated sensitivities and specificities are calculated. In the literature, many comparisons of different approaches can be found, but none explicitly for diagnostic studies. For this reason we compare 13 approaches for a set of scenarios that represent data of diagnostic studies (e.g., with sensitivity and specificity ≥0.8). With simulation studies, we show that the nonparametric interval with normal approximation can be recommended for the difference of two dependent sensitivities or specificities without restriction, the Wald interval with the limitation of slightly anti-conservative results for small sample sizes, and the nonparametric intervals with t-approximation, and the Tango interval with the limitation of conservative results for high correlations.

AB - In diagnostic studies, a new diagnostic test is often compared with a standard test and both tests are applied on the same patients, called paired design. The true disease state is in general given by the so-called gold standard (most reliable method for classification), which has to be known for all patients. The benefit of the new diagnostic test can be evaluated by sensitivity and specificity, which are in fact proportions. This means, for the comparison of two diagnostic tests, confidence intervals for the difference of the dependent estimated sensitivities and specificities are calculated. In the literature, many comparisons of different approaches can be found, but none explicitly for diagnostic studies. For this reason we compare 13 approaches for a set of scenarios that represent data of diagnostic studies (e.g., with sensitivity and specificity ≥0.8). With simulation studies, we show that the nonparametric interval with normal approximation can be recommended for the difference of two dependent sensitivities or specificities without restriction, the Wald interval with the limitation of slightly anti-conservative results for small sample sizes, and the nonparametric intervals with t-approximation, and the Tango interval with the limitation of conservative results for high correlations.

KW - Biometry

KW - Confidence Intervals

KW - Diagnosis

KW - Humans

KW - Hypersensitivity

KW - Models, Statistical

KW - Probability

KW - Sensitivity and Specificity

KW - Comparative Study

KW - Journal Article

U2 - 10.1002/bimj.201200186

DO - 10.1002/bimj.201200186

M3 - SCORING: Journal article

C2 - 23828661

VL - 55

SP - 705

EP - 718

JO - BIOMETRICAL J

JF - BIOMETRICAL J

SN - 0323-3847

IS - 5

ER -