Semantic Image Synthesis for Realistic Image Generation in Robotic Assisted Partial Nephrectomy

Stefano Mazzocchetti, Laura Cercenelli, Lorenzo Bianchi, Lorenzo Bianchi, Riccardo Schiavina, Riccardo Schiavina, Emanuela Marcelli

2024

Abstract

With the continuous evolution of robotic-assisted surgery, the integration of advanced technologies into the field becomes pivotal for improving surgical outcomes. The lack of labelled surgical datasets limits the range of possible applications of deep learning techniques in the surgical field. As a matter of fact, the annotation process to label datasets is time consuming. This paper introduces an approach for realistic image generation in the context of Robotic Assisted Partial Nephrectomy (RAPN) using the Semantic Image Synthesis (SIS) technique. Leveraging descriptive semantic maps, our method aims to bridge the gap between abstract scene representation and visually compelling laparoscopic images. It is shown that our approach can effectively generate photo-realistic Minimally Invasive Surgery (MIS) synthetic images starting from a sparse set of annotated real images. Furthermore, we demonstrate that synthetic data can be used to train a semantic segmentation network that generalizes on real data reducing the annotation time needed.

Paper Citation

in Harvard Style

Mazzocchetti S., Cercenelli L., Bianchi L., Schiavina R. and Marcelli E. (2024). Semantic Image Synthesis for Realistic Image Generation in Robotic Assisted Partial Nephrectomy. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 645-652. DOI: 10.5220/0012611200003660

in Bibtex Style

@conference{visapp24,
author={Stefano Mazzocchetti and Laura Cercenelli and Lorenzo Bianchi and Riccardo Schiavina and Emanuela Marcelli},
title={Semantic Image Synthesis for Realistic Image Generation in Robotic Assisted Partial Nephrectomy},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP},
year={2024},
pages={645-652},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012611200003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP
TI - Semantic Image Synthesis for Realistic Image Generation in Robotic Assisted Partial Nephrectomy
SN - 978-989-758-679-8
AU - Mazzocchetti S.
AU - Cercenelli L.
AU - Bianchi L.
AU - Schiavina R.
AU - Marcelli E.
PY - 2024
SP - 645
EP - 652
DO - 10.5220/0012611200003660
PB - SciTePress