Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Applying cross-modal plasticity principles in auditory training applications

Huang, Qiqi, Stawarz, Katarzyna ORCID: https://orcid.org/0000-0001-9021-0615, Zhao, Linqi, Yang, Shuya, Xie, Wenyu, Song, Fanghao and Liu, Hantao ORCID: https://orcid.org/0000-0003-4544-3481 2025. Applying cross-modal plasticity principles in auditory training applications. International Journal of Human-Computer Studies 203 , 103570. 10.1016/j.ijhcs.2025.103570

[thumbnail of 1-s2.0-S1071581925001272-main.pdf]
Preview
PDF - Published Version
Available under License Creative Commons Attribution.

Download (3MB) | Preview

Abstract

Research indicates that a significant number of individuals are in a suboptimal auditory health state, yet their auditory function can potentially be improved through auditory training. To raise awareness of auditory health issues, auditory training apps should provide effective yet accessible training methods alongside engaging mechanisms that motivate users to adopt and sustain auditory training habits, ultimately facilitating self-directed auditory health management. Current auditory training apps overlook the importance of user needs and motivation, as well as the relationship between the two, leading to low engagement and retention rates. We document the specific needs of both normal-hearing and mildly hearing-impaired users and analyze physiological data collected during auditory training tasks. Through lab experiment study, we provide quantitative evidence supporting the effectiveness of the auditory training method used in this study. The findings indicate that audiovisual-based auditory training contributes to improved auditory performance. Building on these insights, we develop an auditory training app prototype that integrates gamification and narrative design into the auditory training app prototype, and examine their impact on user motivation and engagement. Furthermore, based on the results, we propose design recommendations for future auditory training app development, emphasizing the need to align training effectiveness with user motivation and engagement strategies.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Schools > Computer Science & Informatics
Publisher: Elsevier
ISSN: 1071-5819
Funders: China Scholarship Council (CSC) under Grant No. 202306220080
Date of First Compliant Deposit: 30 June 2025
Date of Acceptance: 5 June 2025
Last Modified: 03 Jul 2025 14:00
URI: https://orca.cardiff.ac.uk/id/eprint/179419

Actions (repository staff only)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics