Research Progress and Prospects of Human-Computer Interaction Based on Multimodal Affective Computing

Bote Chen

2025

Abstract

In the era of intelligence, human-computer interaction is developing towards naturalness, emotion, and personalization, and emotional computing has become a research hotspot. It can identify, understand, and respond to the user's emotional state to enhance the experience. However, single-modal emotional data has limitations and it is difficult to fully reflect emotions. Multimodal emotional computing integrates data such as voice, expression, and physiological signals, significantly improving the accuracy of emotion recognition, and is an important direction for human-computer interaction. This paper systematically sorts out its research progress and discusses it from three aspects: theory, technology, and application. First, the characteristics of multimodal emotional data and the necessity of fusion are explained, and then combined with deep learning, the core technologies such as feature level, decision level, and hybrid fusion are analyzed; then its application cases in scenarios such as intelligent assistants, virtual reality, and intelligent driving are discussed. Finally, the current challenges such as data synchronization, modality loss, noise interference, and model generalization are summarized, and suggestions such as optimizing modal fusion algorithms, expanding data sets, and improving model generalization capabilities are proposed for future research. This paper provides a reference for relevant researchers to promote the development of multimodal emotional computing technology and help the intelligent upgrade of human-computer interaction systems.

Paper Citation

in Harvard Style

Chen B. (2025). Research Progress and Prospects of Human-Computer Interaction Based on Multimodal Affective Computing. In Proceedings of the 2nd International Conference on Engineering Management, Information Technology and Intelligence - Volume 1: EMITI; ISBN 978-989-758-792-4, SciTePress, pages 23-27. DOI: 10.5220/0014306900004718

in Bibtex Style

@conference{emiti25,
author={Bote Chen},
title={Research Progress and Prospects of Human-Computer Interaction Based on Multimodal Affective Computing},
booktitle={Proceedings of the 2nd International Conference on Engineering Management, Information Technology and Intelligence - Volume 1: EMITI},
year={2025},
pages={23-27},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0014306900004718},
isbn={978-989-758-792-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Engineering Management, Information Technology and Intelligence - Volume 1: EMITI
TI - Research Progress and Prospects of Human-Computer Interaction Based on Multimodal Affective Computing
SN - 978-989-758-792-4
AU - Chen B.
PY - 2025
SP - 23
EP - 27
DO - 10.5220/0014306900004718
PB - SciTePress