loading
Documents

Research.Publish.Connect.

Paper

Paper Unlock
LOW-LEVEL FUSION OF AUDIO AND VIDEO FEATURE FOR MULTI-MODAL EMOTION RECOGNITION

Topics: 2D and 3D Scene Understanding; Cognitive & Biologically Inspired Vision; Early Vision and Image Representation; Face and Gesture Recognition; Feature Extraction; Human Activity Recognition; Pattern Recognition in Image Understanding; Real-Time Vision; Segmentation and Grouping; Statistical Approach; Time-Frequency Analysis; Video Analysis

Authors: Matthias Wimmer 1 ; Björn Schuller 2 ; Dejan Arsic 2 ; Gerhard Rigoll 2 and Bernd Radig 3

Affiliations: 1 Perceptual Computing Lab, Faculty of Science and Engineering, Waseda University, Japan ; 2 Institute for Human-Machine Communication, Technische Universität München, Germany ; 3 Technische Universität München, Germany

ISBN: 978-989-8111-21-0

Keyword(s): Emotion Recognition, Audio-visual Processing, Multi-modal Fusion.

Related Ontology Subjects/Areas/Topics: Applications ; Artificial Intelligence ; Biomedical Engineering ; Biomedical Signal Processing ; Computer Vision, Visualization and Computer Graphics ; Data Manipulation ; Early Vision and Image Representation ; Feature Extraction ; Features Extraction ; Health Engineering and Technology Applications ; Human-Computer Interaction ; Image and Video Analysis ; Informatics in Control, Automation and Robotics ; Methodologies and Methods ; Motion, Tracking and Stereo Vision ; Neurocomputing ; Neurotechnology, Electronics and Informatics ; Pattern Recognition ; Physiological Computing Systems ; Real-Time Vision ; Segmentation and Grouping ; Sensor Networks ; Signal Processing, Sensors, Systems Modeling and Control ; Soft Computing ; Software Engineering ; Statistical Approach ; Time-Frequency Analysis ; Video Analysis

Abstract: Bimodal emotion recognition through audiovisual feature fusion has been shown superior over each individual modality in the past. Still, synchronization of the two streams is a challenge, as many vision approaches work on a frame basis opposing audio turn- or chunk-basis. Therefore, late fusion schemes such as simple logic or voting strategies are commonly used for the overall estimation of underlying affect. However, early fusion is known to be more effective in many other multimodal recognition tasks. We therefore suggest a combined analysis by descriptive statistics of audio and video Low-Level-Descriptors for subsequent static SVM Classification. This strategy also allows for a combined feature-space optimization which will be discussed herein. The high effectiveness of this approach is shown on a database of 11.5h containing six emotional situations in an airplane scenario.

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.234.51.17

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Wimmer M.; Schuller B.; Arsic D.; Rigoll G.; Radig B. and (2008). LOW-LEVEL FUSION OF AUDIO AND VIDEO FEATURE FOR MULTI-MODAL EMOTION RECOGNITION.In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 145-151. DOI: 10.5220/0001082801450151

@conference{visapp08,
author={Matthias Wimmer and Björn Schuller and Dejan Arsic and Gerhard Rigoll and Bernd Radig},
title={LOW-LEVEL FUSION OF AUDIO AND VIDEO FEATURE FOR MULTI-MODAL EMOTION RECOGNITION},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={145-151},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001082801450151},
isbn={978-989-8111-21-0},
}

TY - CONF

JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - LOW-LEVEL FUSION OF AUDIO AND VIDEO FEATURE FOR MULTI-MODAL EMOTION RECOGNITION
SN - 978-989-8111-21-0
AU - Wimmer, M.
AU - Schuller, B.
AU - Arsic, D.
AU - Rigoll, G.
AU - Radig, B.
PY - 2008
SP - 145
EP - 151
DO - 10.5220/0001082801450151

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.