Observation-Based Inverse Kinematics for Visual Servo Control

Daniel Nikovski

2025

Abstract

We propose a method for estimating the joint configuration of articulated mechanisms without joint encoders and with unknown forward kinematics, based solely on RGB-D images of the mechanism captured by a stationary camera. The method collects a sequence of such images under a suitable excitation control policy, extracts the 3D locations of keypoints in these images, and determines which of these points must belong to the same link of the mechanism by means of testing their pairwise distances and clustering them using agglomerative clustering. By computing the rigid-body transforms of all bodies with respect to the keypoints’ positions in a reference image and analyzing each body’s transform expressed relative to all other bodies’ coordinate reference frames, the algorithm discovers which pairs of bodies must be connected by a single-degree-of-freedom joint and based on this, discovers the ordering of the bodies in the kinematic chain of the mechanism. The method can be used for pose-based visual servocontrol and other robotics tasks where inverse kinematics is needed, without providing forward kinematics or measurements of the end tool of the robot.

Paper Citation

in Harvard Style

Nikovski D. (2025). Observation-Based Inverse Kinematics for Visual Servo Control. In Proceedings of the 22nd International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO; ISBN 978-989-758-770-2, SciTePress, pages 200-207. DOI: 10.5220/0013701100003982

in Bibtex Style

@conference{icinco25,
author={Daniel Nikovski},
title={Observation-Based Inverse Kinematics for Visual Servo Control},
booktitle={Proceedings of the 22nd International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO},
year={2025},
pages={200-207},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013701100003982},
isbn={978-989-758-770-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 22nd International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO
TI - Observation-Based Inverse Kinematics for Visual Servo Control
SN - 978-989-758-770-2
AU - Nikovski D.
PY - 2025
SP - 200
EP - 207
DO - 10.5220/0013701100003982
PB - SciTePress