DaDe: Delay-Adaptive Detector for Streaming Perception

Wonwoo Jo, Kyungshin Lee, Jaewon Baik, Sangsun Lee, Dongho Choi, Hyunkyoo Park

2023

Abstract

Recognizing the surrounding environment at low latency is critical in autonomous driving. In real-time environment, surrounding environment changes when processing is over. Current detection models are incapable of dealing with changes in the environment that occur after processing. Streaming perception is proposed to assess the latency and accuracy of real-time video perception. However, additional problems arise in real-world applications due to limited hardware resources, high temperatures, and other factors. In this study, we develop a model that can reflect processing delays in real time and produce the most reasonable results. By incorporating the proposed feature queue and feature select module, the system gains the ability to forecast specific time steps without any additional computational costs. Our method is tested on the Argoverse-HD dataset. It achieves higher performance than the current state-of-the-art methods(2022.12) in various environments when delayed . The code is available at https://github.com/danjos95/DADE.

Paper Citation

in Harvard Style

Jo W., Lee K., Baik J., Lee S., Choi D. and Park H. (2023). DaDe: Delay-Adaptive Detector for Streaming Perception. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 39-46. DOI: 10.5220/0011610700003417

in Bibtex Style

@conference{visapp23,
author={Wonwoo Jo and Kyungshin Lee and Jaewon Baik and Sangsun Lee and Dongho Choi and Hyunkyoo Park},
title={DaDe: Delay-Adaptive Detector for Streaming Perception},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP},
year={2023},
pages={39-46},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011610700003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 5: VISAPP
TI - DaDe: Delay-Adaptive Detector for Streaming Perception
SN - 978-989-758-634-7
AU - Jo W.
AU - Lee K.
AU - Baik J.
AU - Lee S.
AU - Choi D.
AU - Park H.
PY - 2023
SP - 39
EP - 46
DO - 10.5220/0011610700003417
PB - SciTePress