Emotion Recognition in Human-Robot Interaction: Multimodal Fusion, Deep Learning, and Ethical Considerations

Yuan Gao

2024

Abstract

This paper explores recent advancements in emotion recognition techniques within Human-Robot Interaction (HRI), focusing on the evolution of perception-based, electroencephalogram (EEG)-based, and multimodal fusion approaches. Emotion recognition has become essential for enhancing the emotional intelligence of robots, which can now better detect and respond to human emotions, particularly within service and healthcare applications. Key contributions of this study include the integration of deep learning models, such as Convolutional Neural Networks (CNNs) and Transformer-based architectures, which have shown significant improvements in real-time emotion recognition accuracy. Additionally, the paper discusses the integration of hardware innovations that optimize responsiveness, enabling robots to provide a more empathetic and supportive experience. This research also examines the role of empathy within social robotics and its ethical implications, covering data privacy, user consent, and the need for fair, unbiased artificial intelligence (AI). By emphasizing the importance of regulatory frameworks, this study outlines the future of emotion-aware AI in safe, ethical, and effective human-robot collaboration.

Paper Citation

in Harvard Style

Gao Y. (2024). Emotion Recognition in Human-Robot Interaction: Multimodal Fusion, Deep Learning, and Ethical Considerations. In Proceedings of the 2nd International Conference on Data Analysis and Machine Learning - Volume 1: DAML; ISBN 978-989-758-754-2, SciTePress, pages 459-465. DOI: 10.5220/0013526100004619

in Bibtex Style

@conference{daml24,
author={Yuan Gao},
title={Emotion Recognition in Human-Robot Interaction: Multimodal Fusion, Deep Learning, and Ethical Considerations},
booktitle={Proceedings of the 2nd International Conference on Data Analysis and Machine Learning - Volume 1: DAML},
year={2024},
pages={459-465},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013526100004619},
isbn={978-989-758-754-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Data Analysis and Machine Learning - Volume 1: DAML
TI - Emotion Recognition in Human-Robot Interaction: Multimodal Fusion, Deep Learning, and Ethical Considerations
SN - 978-989-758-754-2
AU - Gao Y.
PY - 2024
SP - 459
EP - 465
DO - 10.5220/0013526100004619
PB - SciTePress