loading
Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: João Ribeiro Pinto 1 ; 2 ; Pedro Carvalho 1 ; 3 ; Carolina Pinto 4 ; Afonso Sousa 1 ; 2 ; Leonardo Capozzi 1 ; 2 and Jaime S. Cardoso 1 ; 2

Affiliations: 1 Centre for Telecommunications and Multimedia, INESC TEC, Porto, Portugal ; 2 Faculty of Engineering (FEUP), University of Porto, Porto, Portugal ; 3 School of Engineering (ISEP), Polytechnic of Porto, Porto, Portugal ; 4 Bosch Car Multimedia, Braga, Portugal

Keyword(s): Action Recognition, Audio, Cascading, Convolutional Networks, Recurrent Networks, Video.

Abstract: With the advent of self-driving cars, and big companies such as Waymo or Bosch pushing forward into fully driverless transportation services, the in-vehicle behaviour of passengers must be monitored to ensure safety and comfort. The use of audio-visual information is attractive by its spatio-temporal richness as well as non-invasive nature, but faces the likely constraints posed by available hardware and energy consumption. Hence new strategies are required to improve the usage of these scarce resources. We propose the processing of audio and visual data in a cascade pipeline for in-vehicle action recognition. The data is processed by modality-specific sub-modules, with subsequent ones being used when a confident classification is not reached. Experiments show an interesting accuracy-acceleration trade-off when compared with a parallel pipeline with late fusion, presenting potential for industrial applications on embedded devices.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.238.225.8

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pinto, J.; Carvalho, P.; Pinto, C.; Sousa, A.; Capozzi, L. and Cardoso, J. (2022). Streamlining Action Recognition in Autonomous Shared Vehicles with an Audiovisual Cascade Strategy. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP, ISBN 978-989-758-555-5; ISSN 2184-4321, pages 467-474. DOI: 10.5220/0010838900003124

@conference{visapp22,
author={João Ribeiro Pinto. and Pedro Carvalho. and Carolina Pinto. and Afonso Sousa. and Leonardo Capozzi. and Jaime S. Cardoso.},
title={Streamlining Action Recognition in Autonomous Shared Vehicles with an Audiovisual Cascade Strategy},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP,},
year={2022},
pages={467-474},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010838900003124},
isbn={978-989-758-555-5},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 5: VISAPP,
TI - Streamlining Action Recognition in Autonomous Shared Vehicles with an Audiovisual Cascade Strategy
SN - 978-989-758-555-5
IS - 2184-4321
AU - Pinto, J.
AU - Carvalho, P.
AU - Pinto, C.
AU - Sousa, A.
AU - Capozzi, L.
AU - Cardoso, J.
PY - 2022
SP - 467
EP - 474
DO - 10.5220/0010838900003124