Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study

Standard

Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study. / Galinovic, Ivana; Dicken, Volker; Heitz, Johannes; Klein, Jan; Puig, Josep; Guibernau, Jorge; Kemmling, Andre; Gellissen, Susanne; Villringer, Kersten; Neeb, Lars; Gregori, Johannes; Weiler, Florian; Pedraza, Salvador; Thomalla, Götz; Fiehler, Jens; Gerloff, Christian; Fiebach, Jochen B; WAKE-UP Investigators.

in: EUR J RADIOL, Jahrgang 104, 07.2018, S. 115-119.

Publikationen: SCORING: Beitrag in Fachzeitschrift/ZeitungSCORING: ZeitschriftenaufsatzForschungBegutachtung

Harvard

Galinovic, I, Dicken, V, Heitz, J, Klein, J, Puig, J, Guibernau, J, Kemmling, A, Gellissen, S, Villringer, K, Neeb, L, Gregori, J, Weiler, F, Pedraza, S, Thomalla, G, Fiehler, J, Gerloff, C, Fiebach, JB & WAKE-UP Investigators 2018, 'Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study', EUR J RADIOL, Jg. 104, S. 115-119. https://doi.org/10.1016/j.ejrad.2018.05.011

APA

Galinovic, I., Dicken, V., Heitz, J., Klein, J., Puig, J., Guibernau, J., Kemmling, A., Gellissen, S., Villringer, K., Neeb, L., Gregori, J., Weiler, F., Pedraza, S., Thomalla, G., Fiehler, J., Gerloff, C., Fiebach, J. B., & WAKE-UP Investigators (2018). Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study. EUR J RADIOL, 104, 115-119. https://doi.org/10.1016/j.ejrad.2018.05.011

Vancouver

Bibtex

@article{4ba90414ba784ea5bd5e498801a5f274,
title = "Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study",
abstract = "BACKGROUND AND PURPOSE: WAKE-UP is a randomized, placebo-controlled trial of thrombolysis in stroke with unknown time of symptom onset using magnetic resonance imaging criteria to determine patients' eligibility. As it is a multicenter trial, homogeneous interpretation of criteria is an important contributor to the trial's success. We describe the investigator image training as well as results of the quality control done by the central image reading board (CIRB).METHODS: Investigators at local centers were given an imaging manual and passed a software-based image training prior to being allowed to judge images in the trial. Throughout the trial, the CIRB gave feedback to recruiting centers in cases of disagreement regarding a patient's randomization. We evaluated the investigators performance in the image training and analyzed results of this quality control from the first 1069 screened patients. Additionally, we obtained feedback from investigators regarding their experiences with the trial.RESULTS: Four-hundred-and-sixty physicians from eight European countries took part in the image training, of whom 436 (95%) successfully completed it. In the trial, agreement rates between the local investigators and members of the CIRB were high for the presence of an acute ischemic lesion (94%, κ = 0.87) as well as for the judgment of infarct extent (93%, κ = 0.87). Agreement for the criterion of DWI-FLAIR mismatch was 74%, κ = 0.60. The majority of investigators reported that the DWI-FLAIR mismatch was the hardest imaging criterion to evaluate. Ninety-one percent of investigators who responded to our survey stated that the image training specifically increased their confidence when assessing the DWI-FLAIR mismatch.CONCLUSIONS: Despite its multicenter design, the WAKE-UP study has demonstrated a high level of homogeneity amongst raters in interpreting the various imaging criteria for patient randomization, including the novel criterion of DWI-FLAIR mismatch. Systematic image training increased the confidence of investigators in applying imaging criteria.",
keywords = "Brain Ischemia, Computer-Assisted Instruction, Humans, Image Processing, Computer-Assisted, Magnetic Resonance Imaging, Patient Selection, Placebos, Reproducibility of Results, Sensitivity and Specificity, Stroke, Thrombolytic Therapy, Time Factors, Journal Article, Multicenter Study, Randomized Controlled Trial",
author = "Ivana Galinovic and Volker Dicken and Johannes Heitz and Jan Klein and Josep Puig and Jorge Guibernau and Andre Kemmling and Susanne Gellissen and Kersten Villringer and Lars Neeb and Johannes Gregori and Florian Weiler and Salvador Pedraza and G{\"o}tz Thomalla and Jens Fiehler and Christian Gerloff and Fiebach, {Jochen B} and {WAKE-UP Investigators}",
note = "Copyright {\textcopyright} 2018 Elsevier B.V. All rights reserved.",
year = "2018",
month = jul,
doi = "10.1016/j.ejrad.2018.05.011",
language = "English",
volume = "104",
pages = "115--119",
journal = "EUR J RADIOL",
issn = "0720-048X",
publisher = "Elsevier",

}

RIS

TY - JOUR

T1 - Homogeneous application of imaging criteria in a multicenter trial supported by investigator training: A report from the WAKE-UP study

AU - Galinovic, Ivana

AU - Dicken, Volker

AU - Heitz, Johannes

AU - Klein, Jan

AU - Puig, Josep

AU - Guibernau, Jorge

AU - Kemmling, Andre

AU - Gellissen, Susanne

AU - Villringer, Kersten

AU - Neeb, Lars

AU - Gregori, Johannes

AU - Weiler, Florian

AU - Pedraza, Salvador

AU - Thomalla, Götz

AU - Fiehler, Jens

AU - Gerloff, Christian

AU - Fiebach, Jochen B

AU - WAKE-UP Investigators

N1 - Copyright © 2018 Elsevier B.V. All rights reserved.

PY - 2018/7

Y1 - 2018/7

N2 - BACKGROUND AND PURPOSE: WAKE-UP is a randomized, placebo-controlled trial of thrombolysis in stroke with unknown time of symptom onset using magnetic resonance imaging criteria to determine patients' eligibility. As it is a multicenter trial, homogeneous interpretation of criteria is an important contributor to the trial's success. We describe the investigator image training as well as results of the quality control done by the central image reading board (CIRB).METHODS: Investigators at local centers were given an imaging manual and passed a software-based image training prior to being allowed to judge images in the trial. Throughout the trial, the CIRB gave feedback to recruiting centers in cases of disagreement regarding a patient's randomization. We evaluated the investigators performance in the image training and analyzed results of this quality control from the first 1069 screened patients. Additionally, we obtained feedback from investigators regarding their experiences with the trial.RESULTS: Four-hundred-and-sixty physicians from eight European countries took part in the image training, of whom 436 (95%) successfully completed it. In the trial, agreement rates between the local investigators and members of the CIRB were high for the presence of an acute ischemic lesion (94%, κ = 0.87) as well as for the judgment of infarct extent (93%, κ = 0.87). Agreement for the criterion of DWI-FLAIR mismatch was 74%, κ = 0.60. The majority of investigators reported that the DWI-FLAIR mismatch was the hardest imaging criterion to evaluate. Ninety-one percent of investigators who responded to our survey stated that the image training specifically increased their confidence when assessing the DWI-FLAIR mismatch.CONCLUSIONS: Despite its multicenter design, the WAKE-UP study has demonstrated a high level of homogeneity amongst raters in interpreting the various imaging criteria for patient randomization, including the novel criterion of DWI-FLAIR mismatch. Systematic image training increased the confidence of investigators in applying imaging criteria.

AB - BACKGROUND AND PURPOSE: WAKE-UP is a randomized, placebo-controlled trial of thrombolysis in stroke with unknown time of symptom onset using magnetic resonance imaging criteria to determine patients' eligibility. As it is a multicenter trial, homogeneous interpretation of criteria is an important contributor to the trial's success. We describe the investigator image training as well as results of the quality control done by the central image reading board (CIRB).METHODS: Investigators at local centers were given an imaging manual and passed a software-based image training prior to being allowed to judge images in the trial. Throughout the trial, the CIRB gave feedback to recruiting centers in cases of disagreement regarding a patient's randomization. We evaluated the investigators performance in the image training and analyzed results of this quality control from the first 1069 screened patients. Additionally, we obtained feedback from investigators regarding their experiences with the trial.RESULTS: Four-hundred-and-sixty physicians from eight European countries took part in the image training, of whom 436 (95%) successfully completed it. In the trial, agreement rates between the local investigators and members of the CIRB were high for the presence of an acute ischemic lesion (94%, κ = 0.87) as well as for the judgment of infarct extent (93%, κ = 0.87). Agreement for the criterion of DWI-FLAIR mismatch was 74%, κ = 0.60. The majority of investigators reported that the DWI-FLAIR mismatch was the hardest imaging criterion to evaluate. Ninety-one percent of investigators who responded to our survey stated that the image training specifically increased their confidence when assessing the DWI-FLAIR mismatch.CONCLUSIONS: Despite its multicenter design, the WAKE-UP study has demonstrated a high level of homogeneity amongst raters in interpreting the various imaging criteria for patient randomization, including the novel criterion of DWI-FLAIR mismatch. Systematic image training increased the confidence of investigators in applying imaging criteria.

KW - Brain Ischemia

KW - Computer-Assisted Instruction

KW - Humans

KW - Image Processing, Computer-Assisted

KW - Magnetic Resonance Imaging

KW - Patient Selection

KW - Placebos

KW - Reproducibility of Results

KW - Sensitivity and Specificity

KW - Stroke

KW - Thrombolytic Therapy

KW - Time Factors

KW - Journal Article

KW - Multicenter Study

KW - Randomized Controlled Trial

U2 - 10.1016/j.ejrad.2018.05.011

DO - 10.1016/j.ejrad.2018.05.011

M3 - SCORING: Journal article

C2 - 29857856

VL - 104

SP - 115

EP - 119

JO - EUR J RADIOL

JF - EUR J RADIOL

SN - 0720-048X

ER -