Meta-Analysis of Diagnostic Accuracy Studies With Multiple Thresholds

Standard

Meta-Analysis of Diagnostic Accuracy Studies With Multiple Thresholds : Comparison of Approaches in a Simulation Study. / Zapf, Antonia; Frömke, Cornelia; Hardt, Juliane; Rücker, Gerta; Voeltz, Dina; Hoyer, Annika.

In: BIOMETRICAL J, Vol. 66, No. 7, e202300101, 10.2024.

Research output: SCORING: Contribution to journalSCORING: Journal articleResearchpeer-review

Harvard

APA

Vancouver

Bibtex

@article{a15a5ffd11834d89b885a0180f4f62d8,
title = "Meta-Analysis of Diagnostic Accuracy Studies With Multiple Thresholds: Comparison of Approaches in a Simulation Study",
abstract = "The development of methods for the meta-analysis of diagnostic test accuracy (DTA) studies is still an active area of research. While methods for the standard case where each study reports a single pair of sensitivity and specificity are nearly routinely applied nowadays, methods to meta-analyze receiver operating characteristic (ROC) curves are not widely used. This situation is more complex, as each primary DTA study may report on several pairs of sensitivity and specificity, each corresponding to a different threshold. In a case study published earlier, we applied a number of methods for meta-analyzing DTA studies with multiple thresholds to a real-world data example (Zapf et al., Biometrical Journal. 2021; 63(4): 699-711). To date, no simulation study exists that systematically compares different approaches with respect to their performance in various scenarios when the truth is known. In this article, we aim to fill this gap and present the results of a simulation study that compares three frequentist approaches for the meta-analysis of ROC curves. We performed a systematic simulation study, motivated by an example from medical research. In the simulations, all three approaches worked partially well. The approach by Hoyer and colleagues was slightly superior in most scenarios and is recommended in practice.",
keywords = "ROC Curve, Meta-Analysis as Topic, Biometry/methods, Diagnostic Tests, Routine/methods, Humans, Computer Simulation",
author = "Antonia Zapf and Cornelia Fr{\"o}mke and Juliane Hardt and Gerta R{\"u}cker and Dina Voeltz and Annika Hoyer",
note = "{\textcopyright} 2024 The Author(s). Biometrical Journal published by Wiley‐VCH GmbH.",
year = "2024",
month = oct,
doi = "10.1002/bimj.202300101",
language = "English",
volume = "66",
journal = "BIOMETRICAL J",
issn = "0323-3847",
publisher = "Wiley-VCH Verlag GmbH",
number = "7",

}

RIS

TY - JOUR

T1 - Meta-Analysis of Diagnostic Accuracy Studies With Multiple Thresholds

T2 - Comparison of Approaches in a Simulation Study

AU - Zapf, Antonia

AU - Frömke, Cornelia

AU - Hardt, Juliane

AU - Rücker, Gerta

AU - Voeltz, Dina

AU - Hoyer, Annika

N1 - © 2024 The Author(s). Biometrical Journal published by Wiley‐VCH GmbH.

PY - 2024/10

Y1 - 2024/10

N2 - The development of methods for the meta-analysis of diagnostic test accuracy (DTA) studies is still an active area of research. While methods for the standard case where each study reports a single pair of sensitivity and specificity are nearly routinely applied nowadays, methods to meta-analyze receiver operating characteristic (ROC) curves are not widely used. This situation is more complex, as each primary DTA study may report on several pairs of sensitivity and specificity, each corresponding to a different threshold. In a case study published earlier, we applied a number of methods for meta-analyzing DTA studies with multiple thresholds to a real-world data example (Zapf et al., Biometrical Journal. 2021; 63(4): 699-711). To date, no simulation study exists that systematically compares different approaches with respect to their performance in various scenarios when the truth is known. In this article, we aim to fill this gap and present the results of a simulation study that compares three frequentist approaches for the meta-analysis of ROC curves. We performed a systematic simulation study, motivated by an example from medical research. In the simulations, all three approaches worked partially well. The approach by Hoyer and colleagues was slightly superior in most scenarios and is recommended in practice.

AB - The development of methods for the meta-analysis of diagnostic test accuracy (DTA) studies is still an active area of research. While methods for the standard case where each study reports a single pair of sensitivity and specificity are nearly routinely applied nowadays, methods to meta-analyze receiver operating characteristic (ROC) curves are not widely used. This situation is more complex, as each primary DTA study may report on several pairs of sensitivity and specificity, each corresponding to a different threshold. In a case study published earlier, we applied a number of methods for meta-analyzing DTA studies with multiple thresholds to a real-world data example (Zapf et al., Biometrical Journal. 2021; 63(4): 699-711). To date, no simulation study exists that systematically compares different approaches with respect to their performance in various scenarios when the truth is known. In this article, we aim to fill this gap and present the results of a simulation study that compares three frequentist approaches for the meta-analysis of ROC curves. We performed a systematic simulation study, motivated by an example from medical research. In the simulations, all three approaches worked partially well. The approach by Hoyer and colleagues was slightly superior in most scenarios and is recommended in practice.

KW - ROC Curve

KW - Meta-Analysis as Topic

KW - Biometry/methods

KW - Diagnostic Tests, Routine/methods

KW - Humans

KW - Computer Simulation

U2 - 10.1002/bimj.202300101

DO - 10.1002/bimj.202300101

M3 - SCORING: Journal article

C2 - 39330620

VL - 66

JO - BIOMETRICAL J

JF - BIOMETRICAL J

SN - 0323-3847

IS - 7

M1 - e202300101

ER -