Sample Size Estimation of Transfer Learning for Colorectal Cancer Detection

Ruihao Luo, Ruihao Luo, Shuxia Guo, Shuxia Guo, Thomas Bocklitz, Thomas Bocklitz, Thomas Bocklitz

2024

Abstract

Nowadays, deep learning has been widely implemented into biomedical applications, but it is problematic to acquire large annotated medical datasets to train the models. As a technique for reusing knowledge obtained from one domain in another domain, transfer learning can be used with only small datasets. Despite of some current research about model transfer methods for medical images, it is still unclear how sample size influences the model performance. Therefore, this study focuses on the estimation of required sample size for a satisfactory performance, and also compares transfer methods with only 200 images randomly chosen from a colorectal cancer dataset. Firstly, based on a K-fold cross-validation, the balanced accuracies of 3 transfer learning networks (DenseNet121, InceptionV3 and MobileNetV2) were generated, and each network used 3 model transfer methods, respectively. Afterwards, by curve fitting with inverse power law, their learning curves were plotted. Furthermore, the estimation of required sample size as well as the prediction of final performance were calculated for each model. In addition, to investigate how many images are needed for curve fitting, the maximum number of images also changed from 200 to smaller numbers. As a result, it is shown that there is a trade-off between predicted final performance and estimated sample size, and suggested model transfer methods for large datasets do not automatically apply to small datasets. For small datasets, complicated networks are not recommended despite of high final performance, and simple transfer learning methods are more feasible for biomedical applications.

Paper Citation

in Harvard Style

Luo R., Guo S. and Bocklitz T. (2024). Sample Size Estimation of Transfer Learning for Colorectal Cancer Detection. In Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM; ISBN 978-989-758-684-2, SciTePress, pages 841-851. DOI: 10.5220/0012449500003654

in Bibtex Style

@conference{icpram24,
author={Ruihao Luo and Shuxia Guo and Thomas Bocklitz},
title={Sample Size Estimation of Transfer Learning for Colorectal Cancer Detection},
booktitle={Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM},
year={2024},
pages={841-851},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012449500003654},
isbn={978-989-758-684-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM
TI - Sample Size Estimation of Transfer Learning for Colorectal Cancer Detection
SN - 978-989-758-684-2
AU - Luo R.
AU - Guo S.
AU - Bocklitz T.
PY - 2024
SP - 841
EP - 851
DO - 10.5220/0012449500003654
PB - SciTePress