loading
  • Login
  • Sign-Up

Research.Publish.Connect.

Paper

Exploratory Multimodal Data Analysis with Standard Multimedia Player - Multimedia Containers: A Feasible Solution to Make Multimodal Research Data Accessible to the Broad Audience

Topics: Cognitive Models for Interpretation, Integration and Control; Image and Video Coding and Compression; Multimodal and Multi-Sensor Models of Image Formation

Authors: Julius Schöning 1 ; Anna L. Gert 1 ; Alper Açık 2 ; Tim C. Kietzmann 3 ; Gunther Heidemann 1 and Peter König 1

Affiliations: 1 Osnabrück University, Germany ; 2 Özyeğin University, Turkey ; 3 CB2 7EF and Medical Research Council, United Kingdom

ISBN: 978-989-758-225-7

Keyword(s): Multimodal Data Analysis, Visualization, Sonification, Gaze Data, EEG Data.

Related Ontology Subjects/Areas/Topics: Computer Vision, Visualization and Computer Graphics ; Image and Video Coding and Compression ; Image Formation and Preprocessing ; Multimodal and Multi-Sensor Models of Image Formation

Abstract: The analysis of multimodal data comprised of images, videos and additional recordings, such as gaze trajectories, EEG, emotional states, and heart rate is presently only feasible with custom applications. Even exploring such data requires compilation of specific applications that suit a specific dataset only. This need for specific applications arises since all corresponding data are stored in separate files in custom-made distinct data formats. Thus accessing such datasets is cumbersome and time-consuming for experts and virtually impossible for non-experts. To make multimodal research data easily shareable and accessible to a broad audience, like researchers from diverse disciplines and all other interested people, we show how multimedia containers can support the visualization and sonification of scientific data. The use of a container format allows explorative multimodal data analyses with any multimedia player as well as streaming the data via the Internet. We prototyped this app roach on two datasets, both with visualization of gaze data and one with additional sonification of EEG data. In a user study, we asked expert and non-expert users about their experience during an explorative investigation of the data. Based on their statements, our prototype implementation, and the datasets, we discuss the benefit of storing multimodal data, including the corresponding videos or images, in a single multimedia container. In conclusion, we summarize what is necessary for having multimedia containers as a standard for storing multimodal data and give an outlook on how artificial networks can be trained on such standardized containers. (More)

PDF ImageFull Text

Download
Sign In Guest: Register as new SCITEPRESS user or Join INSTICC now for free.

Sign In SCITEPRESS user: please login.

Sign In INSTICC Members: please login. If not a member yet, Join INSTICC now for free.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.162.69.178. INSTICC members have higher download limits (free membership now)

In the current month:
Recent papers: 1 available of 1 total
2+ years older papers: 2 available of 2 total

Paper citation in several formats:
Schöning J., Gert A., Açık A., Kietzmann T., Heidemann G. and König P. (2017). Exploratory Multimodal Data Analysis with Standard Multimedia Player - Multimedia Containers: A Feasible Solution to Make Multimodal Research Data Accessible to the Broad Audience.In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017)ISBN 978-989-758-225-7, pages 272-279. DOI: 10.5220/0006260202720279

@conference{visapp17,
author={Julius Schöning and Anna L. Gert and Alper Açık and Tim C. Kietzmann and Gunther Heidemann and Peter König},
title={Exploratory Multimodal Data Analysis with Standard Multimedia Player - Multimedia Containers: A Feasible Solution to Make Multimodal Research Data Accessible to the Broad Audience},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017)},
year={2017},
pages={272-279},
doi={10.5220/0006260202720279},
isbn={978-989-758-225-7},
}

TY - CONF

JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017)
TI - Exploratory Multimodal Data Analysis with Standard Multimedia Player - Multimedia Containers: A Feasible Solution to Make Multimodal Research Data Accessible to the Broad Audience
SN - 978-989-758-225-7
AU - Schöning J.
AU - Gert A.
AU - Açık A.
AU - Kietzmann T.
AU - Heidemann G.
AU - König P.
PY - 2017
SP - 272
EP - 279
DO - 10.5220/0006260202720279

Sorted by: Show papers

Note: The preferred Subjects/Areas/Topics, listed below for each paper, are those that match the selected paper topics and their ontology superclasses.
More...

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.

Show authors

Note: The preferred Subjects/Areas/Topics, listed below for each author, are those that more frequently used in the author's papers.
More...