Evaluating the Global Rating scale's psychometric properties to assess communication skills of undergraduate medical students in video-recorded simulated patient encounters
Standard
Evaluating the Global Rating scale's psychometric properties to assess communication skills of undergraduate medical students in video-recorded simulated patient encounters. / Bußenius, Lisa; Kadmon, Martina; Berberat, Pascal O; Harendza, Sigrid.
In: PATIENT EDUC COUNS, Vol. 105, No. 3, 01.03.2022, p. 750-755.Research output: SCORING: Contribution to journal › SCORING: Journal article › Research › peer-review
Harvard
APA
Vancouver
Bibtex
}
RIS
TY - JOUR
T1 - Evaluating the Global Rating scale's psychometric properties to assess communication skills of undergraduate medical students in video-recorded simulated patient encounters
AU - Bußenius, Lisa
AU - Kadmon, Martina
AU - Berberat, Pascal O
AU - Harendza, Sigrid
N1 - Copyright © 2021 Elsevier B.V. All rights reserved.
PY - 2022/3/1
Y1 - 2022/3/1
N2 - OBJECTIVES: To evaluate the psychometric properties of the Global Rating scale (GR) as an observer-based tool to assess communication skills of undergraduate medical students in video-recorded patient encounters.METHODS: Seventy advanced undergraduate medical students participated in a simulation-based assessment including patient consultations. Simulated patients rated these encounters with the Consultation and Relational Empathy (CARE) scale. Two independent, blinded raters assessed the videos of the encounters with the GR and another blinded rater with the Clinical Reasoning Indicators Scale (CRI-HT-S). To assess the GR's psychometric properties, we analysed reliability by means of a G-study, interrater reliability by ICC, convergent validity (correlation of GR and CARE), and divergent validity (correlation of GR and CRI-HT-S).RESULTS: We analysed 325 videos of 65 students (56.9% female, mean age 26.1 ± 2.2 years). The G-coefficient was.90. Interrater reliability of the GR was ICC = .95, 95% CI [.91,.97]. CARE and GR correlated moderately (ρ = .47, 95% CI [.25,.65]). GR and CRI-HT-S did not correlate (ρ = .09, 95% CI [-.16,.34]).CONCLUSIONS: With excellent reliability and adequate validity, the quality of the GR as assessment instrument for communication skills could be demonstrated.PRACTICE IMPLICATIONS: The GR is a suitable instrument for video-based rating of communication skills.
AB - OBJECTIVES: To evaluate the psychometric properties of the Global Rating scale (GR) as an observer-based tool to assess communication skills of undergraduate medical students in video-recorded patient encounters.METHODS: Seventy advanced undergraduate medical students participated in a simulation-based assessment including patient consultations. Simulated patients rated these encounters with the Consultation and Relational Empathy (CARE) scale. Two independent, blinded raters assessed the videos of the encounters with the GR and another blinded rater with the Clinical Reasoning Indicators Scale (CRI-HT-S). To assess the GR's psychometric properties, we analysed reliability by means of a G-study, interrater reliability by ICC, convergent validity (correlation of GR and CARE), and divergent validity (correlation of GR and CRI-HT-S).RESULTS: We analysed 325 videos of 65 students (56.9% female, mean age 26.1 ± 2.2 years). The G-coefficient was.90. Interrater reliability of the GR was ICC = .95, 95% CI [.91,.97]. CARE and GR correlated moderately (ρ = .47, 95% CI [.25,.65]). GR and CRI-HT-S did not correlate (ρ = .09, 95% CI [-.16,.34]).CONCLUSIONS: With excellent reliability and adequate validity, the quality of the GR as assessment instrument for communication skills could be demonstrated.PRACTICE IMPLICATIONS: The GR is a suitable instrument for video-based rating of communication skills.
U2 - 10.1016/j.pec.2021.06.001
DO - 10.1016/j.pec.2021.06.001
M3 - SCORING: Journal article
C2 - 34112546
VL - 105
SP - 750
EP - 755
JO - PATIENT EDUC COUNS
JF - PATIENT EDUC COUNS
SN - 0738-3991
IS - 3
ER -
