A model of audio-visual motion integration during active self-movement

Gallagher, Maria, Haynes, Joshua D., Culling, John F. ORCID: https://orcid.org/0000-0003-1107-9802 and Freeman, Tom C. A. ORCID: https://orcid.org/0000-0002-5989-9183 2025. A model of audio-visual motion integration during active self-movement. Journal of Vision 25 , 8. 10.1167/jov.25.2.8

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

Abstract

Despite good evidence for optimal audio–visual integration in stationary observers, few studies have considered the impact of self-movement on this process. When the head and/or eyes move, the integration of vision and hearing is complicated, as the sensory measurements begin in different coordinate frames. To successfully integrate these signals, they must first be transformed into the same coordinate frame. We propose that audio and visual motion cues are separately transformed using self-movement signals, before being integrated as body-centered cues to audio–visual motion. We tested this hypothesis using a psychophysical audio–visual integration task in which participants made left/right judgments of audio, visual, or audio–visual targets during self-generated yaw head rotations. Estimates of precision and bias from the audio and visual conditions were used to predict performance in the audio–visual conditions. We found that audio–visual performance was predicted well by models that suggested the transformation of cues into common coordinates but could not be explained by a model that did not rely on coordinate transformation before integration. We also found that precision specifically was better predicted by a model that accounted for shared noise arising from signals encoding head movement. Taken together, our findings suggest that motion perception in active observers is based on the integration of partially correlated body-centered signals.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Schools > Psychology
Publisher:	Association for Research in Vision and Ophthalmology
ISSN:	1534-7362
Date of First Compliant Deposit:	9 January 2025
Date of Acceptance:	8 January 2025
Last Modified:	20 Feb 2025 12:43
URI:	https://orca.cardiff.ac.uk/id/eprint/175144

Actions (repository staff only)

Edit Item