Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study
Standard
Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study. / Galinovic, Ivana; Dicken, Volker; Heitz, Johannes; Klein, Jan; Puig, Josep; Guibernau, Jorge; Kemmling, Andre; Gellissen, Susanne; Villringer, Kersten; Neeb, Lars; Gregori, Johannes; Weiler, Florian; Pedraza, Salvador; Thomalla, Götz; Fiehler, Jens; Gerloff, Christian; Fiebach, Jochen B; WAKE-UP Investigators.
In: EUR J RADIOL, Vol. 104, 07.2018, p. 115-119.Research output: SCORING: Contribution to journal › SCORING: Journal article › Research › peer-review
Harvard
APA
Vancouver
Bibtex
}
RIS
TY - JOUR
T1 - Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study
AU - Galinovic, Ivana
AU - Dicken, Volker
AU - Heitz, Johannes
AU - Klein, Jan
AU - Puig, Josep
AU - Guibernau, Jorge
AU - Kemmling, Andre
AU - Gellissen, Susanne
AU - Villringer, Kersten
AU - Neeb, Lars
AU - Gregori, Johannes
AU - Weiler, Florian
AU - Pedraza, Salvador
AU - Thomalla, Götz
AU - Fiehler, Jens
AU - Gerloff, Christian
AU - Fiebach, Jochen B
AU - WAKE-UP Investigators
N1 - Copyright © 2018 Elsevier B.V. All rights reserved.
PY - 2018/7
Y1 - 2018/7
N2 - BACKGROUND AND PURPOSE: WAKE-UP is a randomized, placebo-controlled trial of thrombolysis in stroke with unknown time of symptom onset using magnetic resonance imaging criteria to determine patients' eligibility. As it is a multicenter trial, homogeneous interpretation of criteria is an important contributor to the trial's success. We describe the investigator image training as well as results of the quality control done by the central image reading board (CIRB).METHODS: Investigators at local centers were given an imaging manual and passed a software-based image training prior to being allowed to judge images in the trial. Throughout the trial, the CIRB gave feedback to recruiting centers in cases of disagreement regarding a patient's randomization. We evaluated the investigators performance in the image training and analyzed results of this quality control from the first 1069 screened patients. Additionally, we obtained feedback from investigators regarding their experiences with the trial.RESULTS: Four-hundred-and-sixty physicians from eight European countries took part in the image training, of whom 436 (95%) successfully completed it. In the trial, agreement rates between the local investigators and members of the CIRB were high for the presence of an acute ischemic lesion (94%, κ = 0.87) as well as for the judgment of infarct extent (93%, κ = 0.87). Agreement for the criterion of DWI-FLAIR mismatch was 74%, κ = 0.60. The majority of investigators reported that the DWI-FLAIR mismatch was the hardest imaging criterion to evaluate. Ninety-one percent of investigators who responded to our survey stated that the image training specifically increased their confidence when assessing the DWI-FLAIR mismatch.CONCLUSIONS: Despite its multicenter design, the WAKE-UP study has demonstrated a high level of homogeneity amongst raters in interpreting the various imaging criteria for patient randomization, including the novel criterion of DWI-FLAIR mismatch. Systematic image training increased the confidence of investigators in applying imaging criteria.
AB - BACKGROUND AND PURPOSE: WAKE-UP is a randomized, placebo-controlled trial of thrombolysis in stroke with unknown time of symptom onset using magnetic resonance imaging criteria to determine patients' eligibility. As it is a multicenter trial, homogeneous interpretation of criteria is an important contributor to the trial's success. We describe the investigator image training as well as results of the quality control done by the central image reading board (CIRB).METHODS: Investigators at local centers were given an imaging manual and passed a software-based image training prior to being allowed to judge images in the trial. Throughout the trial, the CIRB gave feedback to recruiting centers in cases of disagreement regarding a patient's randomization. We evaluated the investigators performance in the image training and analyzed results of this quality control from the first 1069 screened patients. Additionally, we obtained feedback from investigators regarding their experiences with the trial.RESULTS: Four-hundred-and-sixty physicians from eight European countries took part in the image training, of whom 436 (95%) successfully completed it. In the trial, agreement rates between the local investigators and members of the CIRB were high for the presence of an acute ischemic lesion (94%, κ = 0.87) as well as for the judgment of infarct extent (93%, κ = 0.87). Agreement for the criterion of DWI-FLAIR mismatch was 74%, κ = 0.60. The majority of investigators reported that the DWI-FLAIR mismatch was the hardest imaging criterion to evaluate. Ninety-one percent of investigators who responded to our survey stated that the image training specifically increased their confidence when assessing the DWI-FLAIR mismatch.CONCLUSIONS: Despite its multicenter design, the WAKE-UP study has demonstrated a high level of homogeneity amongst raters in interpreting the various imaging criteria for patient randomization, including the novel criterion of DWI-FLAIR mismatch. Systematic image training increased the confidence of investigators in applying imaging criteria.
KW - Brain Ischemia
KW - Computer-Assisted Instruction
KW - Humans
KW - Image Processing, Computer-Assisted
KW - Magnetic Resonance Imaging
KW - Patient Selection
KW - Placebos
KW - Reproducibility of Results
KW - Sensitivity and Specificity
KW - Stroke
KW - Thrombolytic Therapy
KW - Time Factors
KW - Journal Article
KW - Multicenter Study
KW - Randomized Controlled Trial
U2 - 10.1016/j.ejrad.2018.05.011
DO - 10.1016/j.ejrad.2018.05.011
M3 - SCORING: Journal article
C2 - 29857856
VL - 104
SP - 115
EP - 119
JO - EUR J RADIOL
JF - EUR J RADIOL
SN - 0720-048X
ER -