Optimal Camera Placement for 6D Head Pose Estimation

Harshita Soni, Nikhil Tirumala, Aratrik Chattopadhyay

2025

Abstract

Multi-view systems for 6D head pose estimation have applications in human-computer interaction (HCI), virtual reality, 3D reconstruction etc. In a multi-view system, visibility of facial landmarks is essential for accurately regressing 2D landmarks, which are then triangulated to get 3D fiducials. From these 3D fiducials, the 6D head pose is mathematically derived. Optimal camera placement (OCP) is vital for achieving precise pose estimation. OCP can be formulated as a constrained optimization problem that can be solved using Binary Integer Programming. We redefine two key aspects: the visibility criteria and the camera search space. Our visibility algorithm employs a parametric head model to track fiducials, achieving more precise results than ground truth of CMU(Carnegie Mellon University) Panoptic dataset. Additionally, we geometrically optimize the camera search space, deviating from the baseline of uniformly arranged cameras. Through rigorous experimentation, we prove that not only does this refined search space reduce execution time, but also improves the optimality of the solution, giving 99.9% visibility coverage. We also introduce a heuristic method that reduces the constraint-building time from 27 seconds to just 0.07 seconds per control point, while maintaining concise solutions with minimal effects on visibility metrics.

Paper Citation

in Harvard Style

Soni H., Tirumala N. and Chattopadhyay A. (2025). Optimal Camera Placement for 6D Head Pose Estimation. In Proceedings of the 22nd International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO; ISBN 978-989-758-770-2, SciTePress, pages 82-92. DOI: 10.5220/0013715100003982

in Bibtex Style

@conference{icinco25,
author={Harshita Soni and Nikhil Tirumala and Aratrik Chattopadhyay},
title={Optimal Camera Placement for 6D Head Pose Estimation},
booktitle={Proceedings of the 22nd International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO},
year={2025},
pages={82-92},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013715100003982},
isbn={978-989-758-770-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 22nd International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO
TI - Optimal Camera Placement for 6D Head Pose Estimation
SN - 978-989-758-770-2
AU - Soni H.
AU - Tirumala N.
AU - Chattopadhyay A.
PY - 2025
SP - 82
EP - 92
DO - 10.5220/0013715100003982
PB - SciTePress