Research ExplorerPublicationsContributions of local speech encoding and functional connec...

Contributions of local speech encoding and functional connectivity to audio-visual speech perception

Standard

Contributions of local speech encoding and functional connectivity to audio-visual speech perception. / Giordano, Bruno L; Ince, Robin A A; Gross, Joachim; Schyns, Philippe G; Panzeri, Stefano; Kayser, Christoph.

In: ELIFE, Vol. 6, 07.06.2017.

Research output: SCORING: Contribution to journal › SCORING: Journal article › Research › peer-review

Harvard

Giordano, BL, Ince, RAA, Gross, J, Schyns, PG, Panzeri, S & Kayser, C 2017, 'Contributions of local speech encoding and functional connectivity to audio-visual speech perception', ELIFE, vol. 6. https://doi.org/10.7554/eLife.24763

APA

Giordano, B. L., Ince, R. A. A., Gross, J., Schyns, P. G., Panzeri, S., & Kayser, C. (2017). Contributions of local speech encoding and functional connectivity to audio-visual speech perception. ELIFE, 6. https://doi.org/10.7554/eLife.24763

Vancouver

Giordano BL, Ince RAA, Gross J, Schyns PG, Panzeri S, Kayser C. Contributions of local speech encoding and functional connectivity to audio-visual speech perception. ELIFE. 2017 Jun 7;6. https://doi.org/10.7554/eLife.24763

Bibtex

@article{7df40e335f644b378f648a9a759bb4bd,
title = "Contributions of local speech encoding and functional connectivity to audio-visual speech perception",
abstract = "Seeing a speaker's face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.",
keywords = "Adolescent, Adult, Auditory Perception, Brain Mapping, Female, Frontal Lobe/physiology, Humans, Magnetic Resonance Imaging, Male, Speech Perception, Temporal Lobe/physiology, Visual Perception, Young Adult",
author = "Giordano, {Bruno L} and Ince, {Robin A A} and Joachim Gross and Schyns, {Philippe G} and Stefano Panzeri and Christoph Kayser",
year = "2017",
month = jun,
day = "7",
doi = "10.7554/eLife.24763",
language = "English",
volume = "6",
journal = "ELIFE",
issn = "2050-084X",
publisher = "eLife Sciences Publications",

}

RIS

TY - JOUR

T1 - Contributions of local speech encoding and functional connectivity to audio-visual speech perception

AU - Giordano, Bruno L

AU - Ince, Robin A A

AU - Gross, Joachim

AU - Schyns, Philippe G

AU - Panzeri, Stefano

AU - Kayser, Christoph

PY - 2017/6/7

Y1 - 2017/6/7

N2 - Seeing a speaker's face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.

AB - Seeing a speaker's face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.

KW - Adolescent

KW - Adult

KW - Auditory Perception

KW - Brain Mapping

KW - Female

KW - Frontal Lobe/physiology

KW - Humans

KW - Magnetic Resonance Imaging

KW - Male

KW - Speech Perception

KW - Temporal Lobe/physiology

KW - Visual Perception

KW - Young Adult

U2 - 10.7554/eLife.24763

DO - 10.7554/eLife.24763

M3 - SCORING: Journal article

C2 - 28590903

VL - 6

JO - ELIFE

JF - ELIFE

SN - 2050-084X

ER -