Authors:
Marcus Winter
1
;
Lauren Sweeney
1
;
Katie Mason
1
and
Phil Blume
2
Affiliations:
1
School of Architecture, Technology and Engineering, University of Brighton, Brighton, BN2 4GJ, U.K.
;
2
The Regency Town House, Hove, BN3 1EH, U.K.
Keyword(s):
Machine Learning, Human Pose Estimation, Embodied Interaction, Visitor Engagement, Museums.
Abstract:
Low-power Machine Learning (ML) technologies that process data locally on consumer-level hardware are well suited for interactive applications, however, their potential for audience engagement in museums is largely unexplored. This paper presents a case study using lightweight ML models for human pose estimation and gesture classification to enable visitors’ engagement with interactive projections of interior designs. An empirical evaluation found the application is highly engaging and motivates visitors to learn more about the designs. Uncertainty in ML predictions, experienced as tracking inaccuracies, jitter, or gesture recognition problems, have little impact on their positive user experience. The findings warrant future research to explore the potential of low-power ML for visitor engagement in other use cases and heritage contexts.