loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Hany Ferdinando 1 and Esko Alasaarela 2

Affiliations: 1 University of Oulu and Petra Christian University, Finland ; 2 University of Oulu, Finland

Keyword(s): Emotion Recognition, Feature Fusion, NCA, ECG, EDA.

Related Ontology Subjects/Areas/Topics: Applications ; Cardiovascular Imaging and Cardiography ; Cardiovascular Technologies ; Health Engineering and Technology Applications ; Pattern Recognition ; Signal Processing ; Software Engineering

Abstract: Feature fusion is a common approach to improve the accuracy of the system. Several attemps have been made using this approach on the Mahnob-HCI database for affective recognition, achieving 76% and 68% for valence and arousal respectively as the highest achievements. This study aimed to improve the baselines for both valence and arousal using feature fusion of HRV-based, which used the standard Heart Rate Variability analysis, standardized to mean/standard deviation and normalized to [-1,1], and cvxEDA-based feature, calculated based on a convex optimization approach, to get the new baselines for this database. The selected features, after applying the sequential forward floating search (SFFS), were enhanced by the Neighborhood Component Analysis and fed to kNN classifier to solve 3-class classification problem, validated using leave-one-out (LOO), leave-one-subject-out (LOSO), and 10-fold cross validation methods. The standardized HRV-based features were not selected during the SFFS method, leaving feature fusion from normalized HRV-based and cvxEDA-based features only. The results were compared to previous studies using both single- and multi-modality. Applying the NCA enhanced the features such that the performances in valence set new baselines: 82.4% (LOO validation), 79.6% (10-fold cross validation), and 81.9% (LOSO validation), enhanced the best achievement from both single- and multi-modality. For arousal, the performances were 78.3%, 78.7%, and 77.7% for LOO, LOSO, and 10-fold cross validations respectively. They outperformed the best achievement using feature fusion but could not enhance the performance in single-modality study using cvxEDA-based feature. Some future works include utilizing other feature extraction methods and using more sophisticated classifier other than the simple kNN. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.89.127.249

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Ferdinando, H. and Alasaarela, E. (2018). Enhancement of Emotion Recogniton using Feature Fusion and the Neighborhood Components Analysis. In Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods - ICPRAM; ISBN 978-989-758-276-9; ISSN 2184-4313, SciTePress, pages 463-469. DOI: 10.5220/0006642904630469

@conference{icpram18,
author={Hany Ferdinando. and Esko Alasaarela.},
title={Enhancement of Emotion Recogniton using Feature Fusion and the Neighborhood Components Analysis},
booktitle={Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods - ICPRAM},
year={2018},
pages={463-469},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006642904630469},
isbn={978-989-758-276-9},
issn={2184-4313},
}

TY - CONF

JO - Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods - ICPRAM
TI - Enhancement of Emotion Recogniton using Feature Fusion and the Neighborhood Components Analysis
SN - 978-989-758-276-9
IS - 2184-4313
AU - Ferdinando, H.
AU - Alasaarela, E.
PY - 2018
SP - 463
EP - 469
DO - 10.5220/0006642904630469
PB - SciTePress