Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment

Viking Forsman, Markus Wallmyr, Markus Wallmyr, Taufik Sitompul, Taufik Sitompul, Rikard Lindell

Abstract

Visual perception plays an important role for recognizing possible hazards. In the context of heavy machinery, relevant visual information can be obtained from the machine’s surrounding and from the human-machine interface that exists inside the cabin. In this paper, we propose a method that classifies the occurring collisions by combining the data collected by the eye tracker and the automatic logging mechanism in the mixed reality simulation. Thirteen participants were asked to complete a test scenario in the mixed reality simulation, while wearing an eye tracker. The results demonstrate that we could classify the occurring collisions based on two visual perception conditions: (1) whether the colliding objects were visible from the participants’ field of view and (2) whether the participants have seen the information presented on the human-machine interface before the collisions occurred. This approach enabled us to interpret the occurring collisions differently, compared to the traditional approach that uses the total number of collisions as the representation of participants’ performance.

Download


Paper Citation


in Harvard Style

Forsman V., Wallmyr M., Sitompul T. and Lindell R. (2021). Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment.In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP, ISBN 978-989-758-488-6, pages 255-262. DOI: 10.5220/0010386702550262


in Bibtex Style

@conference{hucapp21,
author={Viking Forsman and Markus Wallmyr and Taufik Sitompul and Rikard Lindell},
title={Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP,},
year={2021},
pages={255-262},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010386702550262},
isbn={978-989-758-488-6},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP,
TI - Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment
SN - 978-989-758-488-6
AU - Forsman V.
AU - Wallmyr M.
AU - Sitompul T.
AU - Lindell R.
PY - 2021
SP - 255
EP - 262
DO - 10.5220/0010386702550262