Contributions of local speech encoding and functional connectivity to audio-visual speech perception
Standard
Contributions of local speech encoding and functional connectivity to audio-visual speech perception. / Giordano, Bruno L; Ince, Robin A A; Gross, Joachim; Schyns, Philippe G; Panzeri, Stefano; Kayser, Christoph.
in: ELIFE, Jahrgang 6, 07.06.2017.Publikationen: SCORING: Beitrag in Fachzeitschrift/Zeitung › SCORING: Zeitschriftenaufsatz › Forschung › Begutachtung
Harvard
APA
Vancouver
Bibtex
}
RIS
TY - JOUR
T1 - Contributions of local speech encoding and functional connectivity to audio-visual speech perception
AU - Giordano, Bruno L
AU - Ince, Robin A A
AU - Gross, Joachim
AU - Schyns, Philippe G
AU - Panzeri, Stefano
AU - Kayser, Christoph
PY - 2017/6/7
Y1 - 2017/6/7
N2 - Seeing a speaker's face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.
AB - Seeing a speaker's face enhances speech intelligibility in adverse environments. We investigated the underlying network mechanisms by quantifying local speech representations and directed connectivity in MEG data obtained while human participants listened to speech of varying acoustic SNR and visual context. During high acoustic SNR speech encoding by temporally entrained brain activity was strong in temporal and inferior frontal cortex, while during low SNR strong entrainment emerged in premotor and superior frontal cortex. These changes in local encoding were accompanied by changes in directed connectivity along the ventral stream and the auditory-premotor axis. Importantly, the behavioral benefit arising from seeing the speaker's face was not predicted by changes in local encoding but rather by enhanced functional connectivity between temporal and inferior frontal cortex. Our results demonstrate a role of auditory-frontal interactions in visual speech representations and suggest that functional connectivity along the ventral pathway facilitates speech comprehension in multisensory environments.
KW - Adolescent
KW - Adult
KW - Auditory Perception
KW - Brain Mapping
KW - Female
KW - Frontal Lobe/physiology
KW - Humans
KW - Magnetic Resonance Imaging
KW - Male
KW - Speech Perception
KW - Temporal Lobe/physiology
KW - Visual Perception
KW - Young Adult
U2 - 10.7554/eLife.24763
DO - 10.7554/eLife.24763
M3 - SCORING: Journal article
C2 - 28590903
VL - 6
JO - ELIFE
JF - ELIFE
SN - 2050-084X
ER -