It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training

Beatrice Biancardi, Yingjie Duan, Mathieu Chollet, Chloé Clavel

2023

Abstract

Most of the emerging public speaking training systems, while very promising, leverage temporal-aggregate features, which do not take into account the structure of the speech. In this paper, we take a different perspective, testing whether some well-known socio-cognitive theories, like first impressions or primacy and recency effect, apply in the distinct context of public speaking perception. We investigated the impact of the temporal location of speech slices (i.e., at the beginning, middle or end) on the perception of confidence and persuasiveness of speakers giving online movie reviews (the Persuasive Opinion Multimedia dataset). Results show that, when considering multi-modality, usually the middle part of speech is the most informative. Additional findings also suggest the interest to leverage local interpretability (by computing SHAP values) to provide feedback directly, both at a specific time (what speech part?) and for a specific behaviour modality or feature (what behaviour?). This is a first step towards the design of more explainable and pedagogical interactive training systems. Such systems could be more efficient by focusing on improving the speaker’s most important behaviour during the most important moments of their performance, and by situating feedback at specific places within the total speech.

Paper Citation

in Harvard Style

Biancardi B., Duan Y., Chollet M. and Clavel C. (2023). It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP; ISBN 978-989-758-634-7, SciTePress, pages 193-200. DOI: 10.5220/0011680400003417

in Bibtex Style

@conference{hucapp23,
author={Beatrice Biancardi and Yingjie Duan and Mathieu Chollet and Chloé Clavel},
title={It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP},
year={2023},
pages={193-200},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011680400003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP
TI - It’s not Just What You Do but also When You Do It: Novel Perspectives for Informing Interactive Public Speaking Training
SN - 978-989-758-634-7
AU - Biancardi B.
AU - Duan Y.
AU - Chollet M.
AU - Clavel C.
PY - 2023
SP - 193
EP - 200
DO - 10.5220/0011680400003417
PB - SciTePress