A data multiverse analysis investigating non-model based SCR quantification approaches

TY - JOUR

T1 - A data multiverse analysis investigating non-model based SCR quantification approaches

AU - Sjouwerman, Rachel

AU - Kuhn, Manuel

AU - Lonsdorf, Tina B

N1 - © 2022 The Authors. Psychophysiology published by Wiley Periodicals LLC on behalf of Society for Psychophysiological Research.

PY - 2022/12

Y1 - 2022/12

N2 - Electrodermal signals are commonly used outcome measures in research on arousal, emotion, and habituation. Recently, we reported on heterogeneity in skin conductance response quantification approaches and its impact on replicability. Here we provide complementary work focusing on within-approach heterogeneity of specifications for skin conductance response quantification. We focus on heterogeneity within the baseline-correction approach (BLC) which appeared as particularly heterogeneous-for instance with respect to the pre-CS baseline window duration, the start, and end of the peak detection window. We systematically scrutinize the robustness of results when applying different BLC approach specifications to one representative pre-existing data set (N = 118) in a (partly) pre-registered study. We report high agreement between different BLC approaches for US and CS+ trials, but moderate to poor agreement for CS- trials. Furthermore, a specification curve of the main effect of CS discrimination during fear acquisition training from all potential and reasonable combinations of specifications (N = 150) and a prototypical trough-to-peak (TTP) approach indicates that resulting effect sizes are largely comparable. A second specification curve (N = 605 specific combinations) highlights a strong impact of different transformation types. Crucially, however, we show that BLC approaches often misclassify the peak value-particularly for CS- trials, leading to stimulus-specific biases and challenges for post-processing and replicability of CS discrimination across studies applying different approaches. Lastly, we investigate how negative skin conductance values in BLC, appearing most frequently for CS- (CS- > CS+ > US), correspond to values in TTP quantification. We discuss the results considering prospects and challenges of the multiverse approach and future directions.

AB - Electrodermal signals are commonly used outcome measures in research on arousal, emotion, and habituation. Recently, we reported on heterogeneity in skin conductance response quantification approaches and its impact on replicability. Here we provide complementary work focusing on within-approach heterogeneity of specifications for skin conductance response quantification. We focus on heterogeneity within the baseline-correction approach (BLC) which appeared as particularly heterogeneous-for instance with respect to the pre-CS baseline window duration, the start, and end of the peak detection window. We systematically scrutinize the robustness of results when applying different BLC approach specifications to one representative pre-existing data set (N = 118) in a (partly) pre-registered study. We report high agreement between different BLC approaches for US and CS+ trials, but moderate to poor agreement for CS- trials. Furthermore, a specification curve of the main effect of CS discrimination during fear acquisition training from all potential and reasonable combinations of specifications (N = 150) and a prototypical trough-to-peak (TTP) approach indicates that resulting effect sizes are largely comparable. A second specification curve (N = 605 specific combinations) highlights a strong impact of different transformation types. Crucially, however, we show that BLC approaches often misclassify the peak value-particularly for CS- trials, leading to stimulus-specific biases and challenges for post-processing and replicability of CS discrimination across studies applying different approaches. Lastly, we investigate how negative skin conductance values in BLC, appearing most frequently for CS- (CS- > CS+ > US), correspond to values in TTP quantification. We discuss the results considering prospects and challenges of the multiverse approach and future directions.

U2 - 10.1111/psyp.14130

DO - 10.1111/psyp.14130

M3 - SCORING: Journal article

C2 - 35780077

VL - 59

JO - PSYCHOPHYSIOLOGY

JF - PSYCHOPHYSIOLOGY

SN - 0048-5772

IS - 12

M1 - e14130

ER -