Adaptive confidence-gated hybrid ensemble framework for speech emotion recognition

Titouni, Salem, Djeffal, Nadhir, Hedir, Abdallah, Belazzoug, Massinissa, Hammache, Boualem and Messaoudene, Idris 2026. Adaptive confidence-gated hybrid ensemble framework for speech emotion recognition. Electronics 15 (9) , 1931. 10.3390/electronics15091931

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

Abstract

Speech Emotion Recognition (SER) is a key enabling technology for advanced human–computer interaction and affective computing. This paper presents an adaptive hybrid SER framework that combines a deep neural feature extraction module with a heterogeneous ensemble of machine learning classifiers, including XGBoost, Support Vector Machines (SVMs), and Random Forest. To overcome the limitations of static fusion strategies, a confidence-gated meta-classification mechanism is introduced to dynamically weight the contribution of each base classifier according to its instance-level reliability. The proposed approach is evaluated on two widely adopted benchmark datasets, EmoDB and SAVEE, achieving competitive accuracies of 98.88% and 91.92%, respectively. Experimental results demonstrate that the proposed fusion strategy significantly improves robustness against inter-speaker variability and emotional ambiguity, while maintaining low computational complexity suitable for real-time implementation. These findings highlight the effectiveness of the proposed framework as a robust and efficient solution for speech emotion recognition. While the model is evaluated on benchmark datasets, it is intended as a foundational component for future emotion-aware systems, including applications in human–computer interaction.

Item Type:	Article
Date Type:	Published Online
Status:	Published
Schools:	Schools > Engineering
Publisher:	MDPI
ISSN:	2079-9292
Date of First Compliant Deposit:	13 May 2026
Date of Acceptance:	26 April 2026
Last Modified:	13 May 2026 08:20
URI:	https://orca.cardiff.ac.uk/id/eprint/186964

Actions (repository staff only)

Edit Item