AUGMENTED REALITY SYSTEM FOR KEYHOLE SURGERY - Performance and Accuracy Validation

Juan José Fuertes, Fernando López-Mir, Valery Naranjo, Mario Ortega, Eliseo Villanueva, Mariano Alcañiz

2011

Abstract

This work presents the performance and validation of an augmented reality (AR) system to help the surgeon for trocar placement in laparoscopic surgery. The virtual organs are obtained by taking previous computed tomography (CT) or magnetic resonance (MR) images of the patient and by applying segmentation methods. Once in the operating theater, a real-time image of the patient is captured with a regular camera that detects the patient’s pose (position + orientation) thanks to a marker that is centered on the navel. Then, 3D virtual organs are registered and fused with the real-time image, helping the surgeon to know the points, at where, to place the trocars. To validate the system’s accuracy and performance, a 3D jar-model is extracted from CT images which is then registered and fused with the real-time jar-image. An error of 2.91 millimeters is measured when the system accuracy is tested.

References

  1. Adhami L. and Coste-Manière É. (2003). Optimal planning for minimally invasive surgical robots. IEEE Transactions on Robotics and Automation (Vol. 19, Sup. 5, pp. 854-863).
  2. Cannon J., Stoll J., Selha S., Dupont P., Howe R., and Torchiana D. (2003). Port placement planning in robot-assisted coronary artery bypass. IEEE Transactions on Robotics and Automation, (Vol. 19, pp. 912-917).
  3. Chiu A. M., Dey D., Drangova M., Boyd W. D., and Peters T. M. (2000). 3-D image guidance for minimally invasive robotic coronary artery bypass. The Heart Surgery Forum (Vol. 3, pp. 224-231).
  4. Feuerstein M. (2007). Augmented Reality in laparoscopic surgery. Tésis Facultad de Informática, Universidad Politécnica de Múnich.
  5. Feuerstein M., Mussack, T., Heining S. M. and Navab N. (2008). Intra-operative laparoscope augmentation for port placement and resection planning in minimally invasive liver resection. IEEE Transactions on Medical Imaging. (Vol. 32, Sup. 3, pp. 355-369).
  6. Feuerstein M., Wildhirt S. M., Bauernschmitt R. and Navab N. (2005). Automatic patient registration for port placement in minimally invasive endoscopic surgery, in Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention (MICCAI). (Vol. 3750, pp. 287-294).
  7. Gonzalez, Rafael C., Woods, Richard E. and Eddins, Steven L., (2004). Digital Image Processing Using MATLAB. Pearson Prentice Hall, (chapters 9-12), Upper Saddle, NJ.
  8. Hartley R. and Zisserman A. (2003). Multiple View Geometry. In Computer Vision, Second Edition, Cambridge University Press.
  9. Ibanez, Schroeder, Ng, Cates. (2005). The ITK software Guide, published by Kitware Inc,.
  10. Marquardt Donald, (1963). An Algorithm for LeastSquares Estimation of Nonlinear Parameters. SIAM Journal on Applied Mathematics. (Vol. 11, pp. 431- 441).
  11. Martin-Gutierrez, J., Saorin, J. L., Contero, M., Alcañiz M., Pérez-López David C., Ortega M. (2010, February). Education: Design and validation of an augmented book for spatial abilities development in engineering students. Computers and Graphics. (Vol. 34 (1), pp. 77-91).
  12. Pandya A., Siadat M., Auner G. (2005). Desing, implementation and accuracy of a prototype for medical augmented reality. Computer Aided Surgery. (Vol. 10 (1), pp. 23-35).
  13. Pintaric T. (2003). An adaptive thresholding algorithm for augmented reality toolkit. In: Proceedings CD of the second IEEE international augmented reality toolkit workshop, ART03.
  14. Scheuering M., Schenk A., Schneider A., Preim B., and Greiner G. (2003). Intraoperative augmented reality for minimally invasive liver interventions. In Medical Imaging 2003: Visualization, Image-Guided Procedures, and Display. Proceedings of SPIE, (Vol. 5029, pp. 407-417).
  15. Simon G., Fitzgibbon A. W., and Zisserman A., (2000, October 5-6). Markerless Tracking using Planar Structures in the Scene. Proceedings of ISAR2000, (pp. 120-128).
  16. Volonte, F., Bucher, P., Pugin, F., Carecchio, A., Sugimoto, M., Ratib, O., Morel, P. (2010 June). Mixed reality for laparoscopic distal pancreatic resection. (Vol. 5, Sup. 1, pp. 122-130).
  17. Schroeder W., Martin K., Lorensen B. (2006). The Visualization Toolkit, Fourth Edition.)
  18. Zhang Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence. (Vol. 22 (11), pp. 1330- 1334).
Download


Paper Citation


in Harvard Style

Fuertes J., López-Mir F., Naranjo V., Ortega M., Villanueva E. and Alcañiz M. (2011). AUGMENTED REALITY SYSTEM FOR KEYHOLE SURGERY - Performance and Accuracy Validation . In Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2011) ISBN 978-989-8425-45-4, pages 273-279. DOI: 10.5220/0003316002730279


in Bibtex Style

@conference{grapp11,
author={Juan José Fuertes and Fernando López-Mir and Valery Naranjo and Mario Ortega and Eliseo Villanueva and Mariano Alcañiz},
title={AUGMENTED REALITY SYSTEM FOR KEYHOLE SURGERY - Performance and Accuracy Validation},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2011)},
year={2011},
pages={273-279},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003316002730279},
isbn={978-989-8425-45-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2011)
TI - AUGMENTED REALITY SYSTEM FOR KEYHOLE SURGERY - Performance and Accuracy Validation
SN - 978-989-8425-45-4
AU - Fuertes J.
AU - López-Mir F.
AU - Naranjo V.
AU - Ortega M.
AU - Villanueva E.
AU - Alcañiz M.
PY - 2011
SP - 273
EP - 279
DO - 10.5220/0003316002730279