Authors:
Asaf Arad
1
;
Julia Leyva I. Torres
1
;
Kristian Nyborg Jespersen
1
;
Nicolaj Boelt Pedersen
1
;
Pablo Rey Valiente
1
;
Alaa El-Hussuna
2
and
Andreas Møgelmose
1
Affiliations:
1
Department of Electronic Systems, Aalborg University, Denmark
;
2
Open Source Research Collaboration, Aalborg, Denmark
Keyword(s):
Automated Performance Metrics, Laparoscopic Surgery, Multi Object Tracking.
Abstract:
The assessment of surgical skill is critical in advancing surgical training and enhancing the performance of surgeons. Traditional evaluation methods relying on human observation and checklists are often biased and inefficient, prompting the need for automated and objective systems. This study explores the use of Automated Performance Metrics (APMs) in laparoscopic surgeries, using video-based data and advanced object tracking techniques. A pipeline was developed, combining a fine-tuned YOLO11 model for detection with state-of-the-art multi-object trackers (MOTs) for tracking surgical tools. Metrics such as path length, velocity, acceleration, jerk, and working area were calculated to assess technical performance. BoT-SORT emerged as the most effective tracker, achieving the highest HOTA and MOTA, enabling robust tool tracking. The system successfully extracted APMs to evaluate and compare surgical performance, demonstrating its potential for objective assessment. This work validates
state-of-the-art algorithms for surgical video analysis, contributing to improved surgical training and performance evaluation. Future efforts should address limitations like pixel-based measurements and dataset variability to enhance the system’s accuracy and applicability, ultimately advancing patient safety and reducing training costs.
(More)