Authors:
Marco Gazzoni
1
;
Marco La Salvia
1
;
Emanuele Torti
1
;
Elisa Marenzi
1
;
Raquel Leon
2
;
Samuel Ortega
3
;
Beatriz Martinez
2
;
Himar Fabelo
2
;
4
;
Gustavo Callicò
2
and
Francesco Leporati
1
Affiliations:
1
University of Pavia, Department of Electrical, Computer and Biomedical Engineering, Via Ferrata 5, Pavia I-27100, Italy
;
2
Research Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria (ULPGC), 35017 Las Palmas de Gran Canaria, Spain
;
3
Norwegian Institute of Food, Fisheries and Aquaculture Research, 9019 Tromsø, Norway
;
4
Fundación Canaria Instituto de Investigación Sanitaria de Canarias and the Research Unit, Hospital Universitario de Gran Canaria Dr. Negrin, Las Palmas de Gran Canaria, Spain
Keyword(s):
Brain Cancer, Computer-Aided Diagnosis, Deep Learning, Disease Diagnosis, Hyperspectral Imaging, Self-Supervised Learning.
Abstract:
Brain tumour resection yields many challenges for neurosurgeons and even though histopathological analysis can help to complete tumour elimination, it is not feasible due to the extent of time and tissue demand for margin inspection. This paper presents a novel attention-based self-supervised methodology to improve current research on medical hyperspectral imaging as a tool for computer-aided diagnosis. We designed a novel architecture comprising the U-Net++ and the attention mechanism on the spectral domain, trained in a self-supervised framework to exploit contrastive learning capabilities and overcome dataset size problems arising in medical scenarios. We operated fifteen hyperspectral images from the publicly available HELICoiD dataset. Enhanced by extensive data augmentation, transfer-learning and self-supervision, we measured accuracy, specificity and recall values above 90% in the automatic end-to-end segmentation of intraoperative glioblastoma hyperspectral images. We evaluat
ed our outcomes with the ground truths produced by the HELICoiD project, obtaining results that are comparable concerning the gold-standard procedure.
(More)