Performing rapid actions affects audiovisual processing

Abstract

Performing rapid upper-limb movements influence audiovisual integration (i.e., Loria et al., 2016a). The re-weighting of target-congruent sensory information, such as the real-time up-regulation of visual processing during visuomotor tasks, may explain the influence of action on audiovisual processing (e.g., Tremblay & Nguyen, 2010). Yet, presenting temporal order judgment (TOJ) stimuli during a rapid movement towards visual and auditory targets has been shown to facilitate visual and auditory processing, while modulating audiovisual processing (i.e., Loria et al., 2016b). The purpose of the current study was to further probe the influence of action on audiovisual integration. Participants performed a flinging movement, requiring the index finger to align with an audiovisual target at peak velocity (PV). At PV, participants were presented with asynchronous auditory, visual, and audiovisual cues from both sides of the target. After each trial, participants judged which sensory cue was presented first in a TOJ task. TOJs were also completed at rest. Theoretically, TOJ accuracy should be optimal in the audiovisual condition (Ernst & Bülthoff, 2004). And if engaging in a rapid goal-directed action specifically influences audiovisual processing, only audiovisual TOJ accuracy should decline between the rest and movement conditions. The results showed greater accuracy for audiovisual than auditory TOJs only at rest while TOJ accuracy did not differ across the sensory conditions after flinging movements. Further, contrasting TOJ accuracy between the resting and movement conditions only revealed a decrease in performance for audiovisual TOJs. Overall, unisensory processing appeared unaffected during rapid limb movements while audiovisual processing was specifically hindered.

Acknowledgments: Natural Sciences and Engineering Research Council of Canada (NSERC), Canada Foundation for Innovation (CFI), Ontario Research Fund (ORF), and University of Toronto Graduate Student Bursary