Research ExplorerPublications#EEGManyLabs: Investigating the replicability of influential...

#EEGManyLabs: Investigating the replicability of influential EEG experiments

Standard

#EEGManyLabs: Investigating the replicability of influential EEG experiments. / Pavlov, Yuri G; Adamian, Nika; Appelhoff, Stefan; Arvaneh, Mahnaz; Benwell, Christopher S Y; Beste, Christian; Bland, Amy R; Bradford, Daniel E; Bublatzky, Florian; Busch, Niko A; Clayson, Peter E; Cruse, Damian; Czeszumski, Artur; Dreber, Anna; Dumas, Guillaume; Ehinger, Benedikt; Ganis, Giorgio; He, Xun; Hinojosa, José A; Huber-Huber, Christoph; Inzlicht, Michael; Jack, Bradley N; Johannesson, Magnus; Jones, Rhiannon; Kalenkovich, Evgenii; Kaltwasser, Laura; Karimi-Rouzbahani, Hamid; Keil, Andreas; König, Peter; Kouara, Layla; Kulke, Louisa; Ladouceur, Cecile D; Langer, Nicolas; Liesefeld, Heinrich R; Luque, David; MacNamara, Annmarie; Mudrik, Liad; Muthuraman, Muthuraman; Neal, Lauren B; Nilsonne, Gustav; Niso, Guiomar; Ocklenburg, Sebastian; Oostenveld, Robert; Pernet, Cyril R; Pourtois, Gilles; Ruzzoli, Manuela; Sass, Sarah M; Schaefer, Alexandre; Senderecka, Magdalena; Snyder, Joel S; Tamnes, Christian K; Tognoli, Emmanuelle; van Vugt, Marieke K; Verona, Edelyn; Vloeberghs, Robin; Welke, Dominik; Wessel, Jan R; Zakharov, Ilya; Mushtaq, Faisal.

In: CORTEX, Vol. 144, 11.2021, p. 213-229.

Research output: SCORING: Contribution to journal › SCORING: Journal article › Research › peer-review

Harvard

Pavlov, YG, Adamian, N, Appelhoff, S, Arvaneh, M, Benwell, CSY, Beste, C, Bland, AR, Bradford, DE, Bublatzky, F, Busch, NA, Clayson, PE, Cruse, D, Czeszumski, A, Dreber, A, Dumas, G, Ehinger, B, Ganis, G, He, X, Hinojosa, JA, Huber-Huber, C, Inzlicht, M, Jack, BN, Johannesson, M, Jones, R, Kalenkovich, E, Kaltwasser, L, Karimi-Rouzbahani, H, Keil, A, König, P, Kouara, L, Kulke, L, Ladouceur, CD, Langer, N, Liesefeld, HR, Luque, D, MacNamara, A, Mudrik, L, Muthuraman, M, Neal, LB, Nilsonne, G, Niso, G, Ocklenburg, S, Oostenveld, R, Pernet, CR, Pourtois, G, Ruzzoli, M, Sass, SM, Schaefer, A, Senderecka, M, Snyder, JS, Tamnes, CK, Tognoli, E, van Vugt, MK, Verona, E, Vloeberghs, R, Welke, D, Wessel, JR, Zakharov, I & Mushtaq, F 2021, '#EEGManyLabs: Investigating the replicability of influential EEG experiments', CORTEX, vol. 144, pp. 213-229. https://doi.org/10.1016/j.cortex.2021.03.013

APA

Pavlov, Y. G., Adamian, N., Appelhoff, S., Arvaneh, M., Benwell, C. S. Y., Beste, C., Bland, A. R., Bradford, D. E., Bublatzky, F., Busch, N. A., Clayson, P. E., Cruse, D., Czeszumski, A., Dreber, A., Dumas, G., Ehinger, B., Ganis, G., He, X., Hinojosa, J. A., ... Mushtaq, F. (2021). #EEGManyLabs: Investigating the replicability of influential EEG experiments. CORTEX, 144, 213-229. https://doi.org/10.1016/j.cortex.2021.03.013

Vancouver

Pavlov YG, Adamian N, Appelhoff S, Arvaneh M, Benwell CSY, Beste C et al. #EEGManyLabs: Investigating the replicability of influential EEG experiments. CORTEX. 2021 Nov;144:213-229. https://doi.org/10.1016/j.cortex.2021.03.013

Bibtex

@article{f1cb6c2111f14853baf5c20257d01e10,
title = "#EEGManyLabs: Investigating the replicability of influential EEG experiments",
abstract = "There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.",
keywords = "Cognition, Electroencephalography, Humans, Neurosciences, Reproducibility of Results",
author = "Pavlov, {Yuri G} and Nika Adamian and Stefan Appelhoff and Mahnaz Arvaneh and Benwell, {Christopher S Y} and Christian Beste and Bland, {Amy R} and Bradford, {Daniel E} and Florian Bublatzky and Busch, {Niko A} and Clayson, {Peter E} and Damian Cruse and Artur Czeszumski and Anna Dreber and Guillaume Dumas and Benedikt Ehinger and Giorgio Ganis and Xun He and Hinojosa, {Jos{\'e} A} and Christoph Huber-Huber and Michael Inzlicht and Jack, {Bradley N} and Magnus Johannesson and Rhiannon Jones and Evgenii Kalenkovich and Laura Kaltwasser and Hamid Karimi-Rouzbahani and Andreas Keil and Peter K{\"o}nig and Layla Kouara and Louisa Kulke and Ladouceur, {Cecile D} and Nicolas Langer and Liesefeld, {Heinrich R} and David Luque and Annmarie MacNamara and Liad Mudrik and Muthuraman Muthuraman and Neal, {Lauren B} and Gustav Nilsonne and Guiomar Niso and Sebastian Ocklenburg and Robert Oostenveld and Pernet, {Cyril R} and Gilles Pourtois and Manuela Ruzzoli and Sass, {Sarah M} and Alexandre Schaefer and Magdalena Senderecka and Snyder, {Joel S} and Tamnes, {Christian K} and Emmanuelle Tognoli and {van Vugt}, {Marieke K} and Edelyn Verona and Robin Vloeberghs and Dominik Welke and Wessel, {Jan R} and Ilya Zakharov and Faisal Mushtaq",
note = "Copyright {\textcopyright} 2021 The Authors. Published by Elsevier Ltd.. All rights reserved.",
year = "2021",
month = nov,
doi = "10.1016/j.cortex.2021.03.013",
language = "English",
volume = "144",
pages = "213--229",
journal = "CORTEX",
issn = "0010-9452",
publisher = "Masson SpA",

}

RIS

TY - JOUR

T1 - #EEGManyLabs: Investigating the replicability of influential EEG experiments

AU - Pavlov, Yuri G

AU - Adamian, Nika

AU - Appelhoff, Stefan

AU - Arvaneh, Mahnaz

AU - Benwell, Christopher S Y

AU - Beste, Christian

AU - Bland, Amy R

AU - Bradford, Daniel E

AU - Bublatzky, Florian

AU - Busch, Niko A

AU - Clayson, Peter E

AU - Cruse, Damian

AU - Czeszumski, Artur

AU - Dreber, Anna

AU - Dumas, Guillaume

AU - Ehinger, Benedikt

AU - Ganis, Giorgio

AU - He, Xun

AU - Hinojosa, José A

AU - Huber-Huber, Christoph

AU - Inzlicht, Michael

AU - Jack, Bradley N

AU - Johannesson, Magnus

AU - Jones, Rhiannon

AU - Kalenkovich, Evgenii

AU - Kaltwasser, Laura

AU - Karimi-Rouzbahani, Hamid

AU - Keil, Andreas

AU - König, Peter

AU - Kouara, Layla

AU - Kulke, Louisa

AU - Ladouceur, Cecile D

AU - Langer, Nicolas

AU - Liesefeld, Heinrich R

AU - Luque, David

AU - MacNamara, Annmarie

AU - Mudrik, Liad

AU - Muthuraman, Muthuraman

AU - Neal, Lauren B

AU - Nilsonne, Gustav

AU - Niso, Guiomar

AU - Ocklenburg, Sebastian

AU - Oostenveld, Robert

AU - Pernet, Cyril R

AU - Pourtois, Gilles

AU - Ruzzoli, Manuela

AU - Sass, Sarah M

AU - Schaefer, Alexandre

AU - Senderecka, Magdalena

AU - Snyder, Joel S

AU - Tamnes, Christian K

AU - Tognoli, Emmanuelle

AU - van Vugt, Marieke K

AU - Verona, Edelyn

AU - Vloeberghs, Robin

AU - Welke, Dominik

AU - Wessel, Jan R

AU - Zakharov, Ilya

AU - Mushtaq, Faisal

N1 - Copyright © 2021 The Authors. Published by Elsevier Ltd.. All rights reserved.

PY - 2021/11

Y1 - 2021/11

N2 - There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

AB - There is growing awareness across the neuroscience community that the replicability of findings about the relationship between brain activity and cognitive phenomena can be improved by conducting studies with high statistical power that adhere to well-defined and standardised analysis pipelines. Inspired by recent efforts from the psychological sciences, and with the desire to examine some of the foundational findings using electroencephalography (EEG), we have launched #EEGManyLabs, a large-scale international collaborative replication effort. Since its discovery in the early 20th century, EEG has had a profound influence on our understanding of human cognition, but there is limited evidence on the replicability of some of the most highly cited discoveries. After a systematic search and selection process, we have identified 27 of the most influential and continually cited studies in the field. We plan to directly test the replicability of key findings from 20 of these studies in teams of at least three independent laboratories. The design and protocol of each replication effort will be submitted as a Registered Report and peer-reviewed prior to data collection. Prediction markets, open to all EEG researchers, will be used as a forecasting tool to examine which findings the community expects to replicate. This project will update our confidence in some of the most influential EEG findings and generate a large open access database that can be used to inform future research practices. Finally, through this international effort, we hope to create a cultural shift towards inclusive, high-powered multi-laboratory collaborations.

KW - Cognition

KW - Electroencephalography

KW - Humans

KW - Neurosciences

KW - Reproducibility of Results

U2 - 10.1016/j.cortex.2021.03.013

DO - 10.1016/j.cortex.2021.03.013

M3 - SCORING: Journal article

C2 - 33965167

VL - 144

SP - 213

EP - 229

JO - CORTEX

JF - CORTEX

SN - 0010-9452

ER -