Inter-rater reliability and double reading analysis of an automated three-dimensional breast ultrasound system: comparison of two independent examiners

Standard

Inter-rater reliability and double reading analysis of an automated three-dimensional breast ultrasound system: comparison of two independent examiners. / Maier, Anna; Heil, Joerg; Lauer, Anna; Harcos, Aba; Schaefgen, Benedikt; von Au, Alexandra; Spratte, Julia; Riedel, Fabian; Rauch, Geraldine; Hennigs, André; Domschke, Christoph; Schott, Sarah; Rom, Joachim; Schuetz, Florian; Sohn, Christof; Golatta, Michael.

in: ARCH GYNECOL OBSTET, Jahrgang 296, Nr. 3, 09.2017, S. 571-582.

Publikationen: SCORING: Beitrag in Fachzeitschrift/ZeitungSCORING: ZeitschriftenaufsatzForschungBegutachtung

Harvard

Maier, A, Heil, J, Lauer, A, Harcos, A, Schaefgen, B, von Au, A, Spratte, J, Riedel, F, Rauch, G, Hennigs, A, Domschke, C, Schott, S, Rom, J, Schuetz, F, Sohn, C & Golatta, M 2017, 'Inter-rater reliability and double reading analysis of an automated three-dimensional breast ultrasound system: comparison of two independent examiners', ARCH GYNECOL OBSTET, Jg. 296, Nr. 3, S. 571-582. https://doi.org/10.1007/s00404-017-4473-y

APA

Maier, A., Heil, J., Lauer, A., Harcos, A., Schaefgen, B., von Au, A., Spratte, J., Riedel, F., Rauch, G., Hennigs, A., Domschke, C., Schott, S., Rom, J., Schuetz, F., Sohn, C., & Golatta, M. (2017). Inter-rater reliability and double reading analysis of an automated three-dimensional breast ultrasound system: comparison of two independent examiners. ARCH GYNECOL OBSTET, 296(3), 571-582. https://doi.org/10.1007/s00404-017-4473-y

Vancouver

Bibtex

@article{74f318efb7f1452db957b3d4c858db4a,
title = "Inter-rater reliability and double reading analysis of an automated three-dimensional breast ultrasound system: comparison of two independent examiners",
abstract = "PURPOSE: Breast ultrasound could be a valuable tool complementary to mammography in breast cancer screening. Automated 3D breast ultrasound (ABUS) addresses challenges of hand-held ultrasound and could allow double reading analysis of ultrasound images. This trial assesses the inter-rater reliability and double reading analysis of an ABUS system.METHODS: To assess the reproducibility and diagnostic validity of the ABUS system, SomoV{\texttrademark}, a blinded double reading analysis, was performed in 1019 patients (2038 breasts) by two examiners (examiner A/B) and compared to single reading results, as well as to the reference standard regarding its diagnostic validity. Cohen's kappa coefficients were calculated to measure the inter-rater reliability and agreement of the different diagnostic modalities. Patient comfort and time consumption for image acquisition and reading were analyzed descriptively as secondary objectives.RESULTS: Analysis of inter-rater reliability yielded agreement in 81.6% (κ = 0.37; p < 0.0001) showing fair agreement. Single reading analysis of SomoV{\texttrademark} exams (examiner A/examiner B) compared to reference standard showed good specificity (examiner A: 88.3%/examiner B: 84.5%), fair inter-rater agreement (examiner A: κ = 0.31/examiner B: κ = 0.31), and adequate sensitivity (examiner A: 53.1%/examiner B: 64.2%). Double reading analysis yielded good sensitivity and specificity (73.7 and 77.7%). Mammography (n = 1911) alone detected 160 of 176 carcinomas (sensitivity 90.1%). Adding SomoV{\texttrademark} to mammography would have detected 12 additional carcinomas, resulting in a higher sensitivity of 97.7%.CONCLUSION: SomoV{\texttrademark} is a promising technique with good sensitivity, high patient comfort, and fair inter-examiner reliability. It allows double reading analysis that, in combination with mammography, could increase detection rates in breast cancer screening.",
keywords = "Journal Article",
author = "Anna Maier and Joerg Heil and Anna Lauer and Aba Harcos and Benedikt Schaefgen and {von Au}, Alexandra and Julia Spratte and Fabian Riedel and Geraldine Rauch and Andr{\'e} Hennigs and Christoph Domschke and Sarah Schott and Joachim Rom and Florian Schuetz and Christof Sohn and Michael Golatta",
year = "2017",
month = sep,
doi = "10.1007/s00404-017-4473-y",
language = "English",
volume = "296",
pages = "571--582",
journal = "ARCH GYNECOL OBSTET",
issn = "0932-0067",
publisher = "Springer",
number = "3",

}

RIS

TY - JOUR

T1 - Inter-rater reliability and double reading analysis of an automated three-dimensional breast ultrasound system: comparison of two independent examiners

AU - Maier, Anna

AU - Heil, Joerg

AU - Lauer, Anna

AU - Harcos, Aba

AU - Schaefgen, Benedikt

AU - von Au, Alexandra

AU - Spratte, Julia

AU - Riedel, Fabian

AU - Rauch, Geraldine

AU - Hennigs, André

AU - Domschke, Christoph

AU - Schott, Sarah

AU - Rom, Joachim

AU - Schuetz, Florian

AU - Sohn, Christof

AU - Golatta, Michael

PY - 2017/9

Y1 - 2017/9

N2 - PURPOSE: Breast ultrasound could be a valuable tool complementary to mammography in breast cancer screening. Automated 3D breast ultrasound (ABUS) addresses challenges of hand-held ultrasound and could allow double reading analysis of ultrasound images. This trial assesses the inter-rater reliability and double reading analysis of an ABUS system.METHODS: To assess the reproducibility and diagnostic validity of the ABUS system, SomoV™, a blinded double reading analysis, was performed in 1019 patients (2038 breasts) by two examiners (examiner A/B) and compared to single reading results, as well as to the reference standard regarding its diagnostic validity. Cohen's kappa coefficients were calculated to measure the inter-rater reliability and agreement of the different diagnostic modalities. Patient comfort and time consumption for image acquisition and reading were analyzed descriptively as secondary objectives.RESULTS: Analysis of inter-rater reliability yielded agreement in 81.6% (κ = 0.37; p < 0.0001) showing fair agreement. Single reading analysis of SomoV™ exams (examiner A/examiner B) compared to reference standard showed good specificity (examiner A: 88.3%/examiner B: 84.5%), fair inter-rater agreement (examiner A: κ = 0.31/examiner B: κ = 0.31), and adequate sensitivity (examiner A: 53.1%/examiner B: 64.2%). Double reading analysis yielded good sensitivity and specificity (73.7 and 77.7%). Mammography (n = 1911) alone detected 160 of 176 carcinomas (sensitivity 90.1%). Adding SomoV™ to mammography would have detected 12 additional carcinomas, resulting in a higher sensitivity of 97.7%.CONCLUSION: SomoV™ is a promising technique with good sensitivity, high patient comfort, and fair inter-examiner reliability. It allows double reading analysis that, in combination with mammography, could increase detection rates in breast cancer screening.

AB - PURPOSE: Breast ultrasound could be a valuable tool complementary to mammography in breast cancer screening. Automated 3D breast ultrasound (ABUS) addresses challenges of hand-held ultrasound and could allow double reading analysis of ultrasound images. This trial assesses the inter-rater reliability and double reading analysis of an ABUS system.METHODS: To assess the reproducibility and diagnostic validity of the ABUS system, SomoV™, a blinded double reading analysis, was performed in 1019 patients (2038 breasts) by two examiners (examiner A/B) and compared to single reading results, as well as to the reference standard regarding its diagnostic validity. Cohen's kappa coefficients were calculated to measure the inter-rater reliability and agreement of the different diagnostic modalities. Patient comfort and time consumption for image acquisition and reading were analyzed descriptively as secondary objectives.RESULTS: Analysis of inter-rater reliability yielded agreement in 81.6% (κ = 0.37; p < 0.0001) showing fair agreement. Single reading analysis of SomoV™ exams (examiner A/examiner B) compared to reference standard showed good specificity (examiner A: 88.3%/examiner B: 84.5%), fair inter-rater agreement (examiner A: κ = 0.31/examiner B: κ = 0.31), and adequate sensitivity (examiner A: 53.1%/examiner B: 64.2%). Double reading analysis yielded good sensitivity and specificity (73.7 and 77.7%). Mammography (n = 1911) alone detected 160 of 176 carcinomas (sensitivity 90.1%). Adding SomoV™ to mammography would have detected 12 additional carcinomas, resulting in a higher sensitivity of 97.7%.CONCLUSION: SomoV™ is a promising technique with good sensitivity, high patient comfort, and fair inter-examiner reliability. It allows double reading analysis that, in combination with mammography, could increase detection rates in breast cancer screening.

KW - Journal Article

U2 - 10.1007/s00404-017-4473-y

DO - 10.1007/s00404-017-4473-y

M3 - SCORING: Journal article

C2 - 28748340

VL - 296

SP - 571

EP - 582

JO - ARCH GYNECOL OBSTET

JF - ARCH GYNECOL OBSTET

SN - 0932-0067

IS - 3

ER -