Detecting and Locating Boats using a PTZ Camera with Both Optical and Thermal Sensors

Christoffer Simonsen, Frederik Thiesson, Øyvind Holtskog, Rikke Gade

Abstract

A harbor traffic monitoring system is necessary for most ports, yet current systems are often not able to detect and receive information from boats without transponders. In this paper we propose a computer vision based monitoring system utilizing the multi-modal properties of a PTZ (pan, tilt, zoom) camera with both an optical and thermal sensor in order to detect boats in different lighting and weather conditions. In both domains boats are detected using a YOLOv3 network pretrained on the COCO dataset and retrained using transfer-learning to images of boats in the test environment. The boats are then positioned on the water using ray-casting. The system is able to detect boats with an average precision of 95.53% and 96.82% in the optical and thermal domains, respectively. Furthermore, it is also able to detect boats in low optical lighting conditions, without being trained with data from such conditions, with an average precision of 15.05% and 46.05% in the optical and thermal domains, respectively. The position estimator, based on a single camera, is able to determine the position of the boats with a mean error of 18.58 meters and a standard deviation of 17.97 meters.

Paper Citation

in Harvard Style

Simonsen C., Thiesson F., Holtskog Ø. and Gade R. (2020). Detecting and Locating Boats using a PTZ Camera with Both Optical and Thermal Sensors.In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, ISBN 978-989-758-402-2, pages 395-403. DOI: 10.5220/0008972603950403

in Bibtex Style

@conference{visapp20,
author={Christoffer Simonsen and Frederik Thiesson and Øyvind Holtskog and Rikke Gade},
title={Detecting and Locating Boats using a PTZ Camera with Both Optical and Thermal Sensors},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP,},
year={2020},
pages={395-403},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008972603950403},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP,
TI - Detecting and Locating Boats using a PTZ Camera with Both Optical and Thermal Sensors
SN - 978-989-758-402-2
AU - Simonsen C.
AU - Thiesson F.
AU - Holtskog Ø.
AU - Gade R.
PY - 2020
SP - 395
EP - 403
DO - 10.5220/0008972603950403