Research ExplorerPublicationsChallenges and lessons learned from using anchoring vignette...

Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior

Standard

Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior. / Topp, Janine; Heesen, Christoph; Augustin, Matthias; Andrees, Valerie; Blome, Christine.

In: QUAL LIFE RES, Vol. 29, No. 8, 08.2020, p. 2149-2159.

Research output: SCORING: Contribution to journal › SCORING: Journal article › Research › peer-review

Harvard

Topp, J, Heesen, C, Augustin, M, Andrees, V & Blome, C 2020, 'Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior', QUAL LIFE RES, vol. 29, no. 8, pp. 2149-2159. https://doi.org/10.1007/s11136-020-02488-4

APA

Topp, J., Heesen, C., Augustin, M., Andrees, V., & Blome, C. (2020). Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior. QUAL LIFE RES, 29(8), 2149-2159. https://doi.org/10.1007/s11136-020-02488-4

Vancouver

Topp J, Heesen C, Augustin M, Andrees V, Blome C. Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior. QUAL LIFE RES. 2020 Aug;29(8):2149-2159. https://doi.org/10.1007/s11136-020-02488-4

Bibtex

@article{e20e1c4ecb9c451bbddd2bb20895631c,
title = "Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior",
abstract = "PURPOSE: Asking patients to rate health-related quality of life (HRQoL) of hypothetical individuals described in anchoring vignettes has been proposed to enhance knowledge on how patients understand and respond to HRQoL questionnaires. In this article, we describe the development of anchoring vignettes and explore their utility for measuring response shift in patients' self-reports of HRQoL.METHODS: We conducted an explorative mixed-methods study. One hundred patients with multiple sclerosis or psoriasis participated in two interviews at intervals of 3-6 months. During both interviews, patients assessed HRQoL of 16 hypothetical individuals on the SF-12 questionnaire (two vignettes for each of the eight domains of the SF-12). In addition to these quantitative ratings, we used the think-aloud method to explore changes in patients' verbalization of their decision processes during vignette ratings.RESULTS: Agreement of vignette ratings at baseline and follow-up was low (ICCs < 0.55). In addition, paired sample t-tests revealed no significant directional mean changes in vignette ratings. Thus, ratings changed non-directionally, neither confirming retest reliability nor a systematic change of assessment. Furthermore, patients' verbalization of their decision processes did not indicate whether or not the assessment strategy of individual patients had changed.CONCLUSIONS: Patients' ratings of anchoring vignettes fluctuate non-directionally over time. The think-aloud method appears not to be informative in exploring whether these fluctuations are due to changes in the individual decision process. Overall, vignettes might not be an appropriate approach to explore response shift, at least with regard to the specific target population and the use of the SF-12.",
keywords = "Female, Humans, Male, Middle Aged, Multiple Sclerosis/epidemiology, Psoriasis/epidemiology, Quality of Life/psychology, Reproducibility of Results, Research Design, Self Report, Surveys and Questionnaires",
author = "Janine Topp and Christoph Heesen and Matthias Augustin and Valerie Andrees and Christine Blome",
year = "2020",
month = aug,
doi = "10.1007/s11136-020-02488-4",
language = "English",
volume = "29",
pages = "2149--2159",
journal = "QUAL LIFE RES",
issn = "0962-9343",
publisher = "Springer Netherlands",
number = "8",

}

RIS

TY - JOUR

T1 - Challenges and lessons learned from using anchoring vignettes to explore quality of life response behavior

AU - Topp, Janine

AU - Heesen, Christoph

AU - Augustin, Matthias

AU - Andrees, Valerie

AU - Blome, Christine

PY - 2020/8

Y1 - 2020/8

N2 - PURPOSE: Asking patients to rate health-related quality of life (HRQoL) of hypothetical individuals described in anchoring vignettes has been proposed to enhance knowledge on how patients understand and respond to HRQoL questionnaires. In this article, we describe the development of anchoring vignettes and explore their utility for measuring response shift in patients' self-reports of HRQoL.METHODS: We conducted an explorative mixed-methods study. One hundred patients with multiple sclerosis or psoriasis participated in two interviews at intervals of 3-6 months. During both interviews, patients assessed HRQoL of 16 hypothetical individuals on the SF-12 questionnaire (two vignettes for each of the eight domains of the SF-12). In addition to these quantitative ratings, we used the think-aloud method to explore changes in patients' verbalization of their decision processes during vignette ratings.RESULTS: Agreement of vignette ratings at baseline and follow-up was low (ICCs < 0.55). In addition, paired sample t-tests revealed no significant directional mean changes in vignette ratings. Thus, ratings changed non-directionally, neither confirming retest reliability nor a systematic change of assessment. Furthermore, patients' verbalization of their decision processes did not indicate whether or not the assessment strategy of individual patients had changed.CONCLUSIONS: Patients' ratings of anchoring vignettes fluctuate non-directionally over time. The think-aloud method appears not to be informative in exploring whether these fluctuations are due to changes in the individual decision process. Overall, vignettes might not be an appropriate approach to explore response shift, at least with regard to the specific target population and the use of the SF-12.

AB - PURPOSE: Asking patients to rate health-related quality of life (HRQoL) of hypothetical individuals described in anchoring vignettes has been proposed to enhance knowledge on how patients understand and respond to HRQoL questionnaires. In this article, we describe the development of anchoring vignettes and explore their utility for measuring response shift in patients' self-reports of HRQoL.METHODS: We conducted an explorative mixed-methods study. One hundred patients with multiple sclerosis or psoriasis participated in two interviews at intervals of 3-6 months. During both interviews, patients assessed HRQoL of 16 hypothetical individuals on the SF-12 questionnaire (two vignettes for each of the eight domains of the SF-12). In addition to these quantitative ratings, we used the think-aloud method to explore changes in patients' verbalization of their decision processes during vignette ratings.RESULTS: Agreement of vignette ratings at baseline and follow-up was low (ICCs < 0.55). In addition, paired sample t-tests revealed no significant directional mean changes in vignette ratings. Thus, ratings changed non-directionally, neither confirming retest reliability nor a systematic change of assessment. Furthermore, patients' verbalization of their decision processes did not indicate whether or not the assessment strategy of individual patients had changed.CONCLUSIONS: Patients' ratings of anchoring vignettes fluctuate non-directionally over time. The think-aloud method appears not to be informative in exploring whether these fluctuations are due to changes in the individual decision process. Overall, vignettes might not be an appropriate approach to explore response shift, at least with regard to the specific target population and the use of the SF-12.

KW - Female

KW - Humans

KW - Male

KW - Middle Aged

KW - Multiple Sclerosis/epidemiology

KW - Psoriasis/epidemiology

KW - Quality of Life/psychology

KW - Reproducibility of Results

KW - Research Design

KW - Self Report

KW - Surveys and Questionnaires

U2 - 10.1007/s11136-020-02488-4

DO - 10.1007/s11136-020-02488-4

M3 - SCORING: Journal article

C2 - 32303892

VL - 29

SP - 2149

EP - 2159

JO - QUAL LIFE RES

JF - QUAL LIFE RES

SN - 0962-9343

IS - 8

ER -