Multimodal integration in statistical learning: evidence from the McGurk illusion

Frontiers in Psychology 5:85721 (2014)
  Copy   BIBTEX

Abstract

Recent advances in the field of statistical learning have established that learners are able to track regularities of multimodal stimuli, yet it is unknown whether the statistical computations are performed on integrated representations or on separate, unimodal representations. In the present study, we investigated the ability of adults to integrate audio and visual input during statistical learning. We presented learners with a speech stream synchronized with a video of a speaker’s face. In the critical condition, the visual (e.g. /gi/) and auditory (e.g. /mi/) signals were occasionally incongruent, which we predicted would produce the McGurk illusion, resulting in the perception of an audiovisual syllable (e.g. /ni/). In this way, we used the McGurk illusion to manipulate the underlying statistical structure of the speech streams, such that perception of these illusory syllables facilitated participants’ ability to segment the speech stream. Our results therefore demonstrate that participants can integrate audio and visual input to perceive the McGurk illusion during statistical learning. We interpret our findings as support for modality-interactive accounts of statistical learning.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 90,616

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Is the Auditory System Cognitively Penetrable?Dimitria Electra Gatzia & Berit Brogaard - 2015 - Multisensory Integration: Brain, Body, and the World.

Analytics

Added to PP
2016-06-30

Downloads
14 (#846,545)

6 months
2 (#668,348)

Historical graph of downloads
How can I increase my downloads?

Author's Profile