Polyp Segmentation Generalisability of Pretrained Backbones

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sanderson, Edward, Matuszewski, Bogdan J.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913361488248832
author Sanderson, Edward
Matuszewski, Bogdan J.
author_facet Sanderson, Edward
Matuszewski, Bogdan J.
contents It has recently been demonstrated that pretraining backbones in a self-supervised manner generally provides better fine-tuned polyp segmentation performance, and that models with ViT-B backbones typically perform better than models with ResNet50 backbones. In this paper, we extend this recent work to consider generalisability. I.e., we assess the performance of models on a different dataset to that used for fine-tuning, accounting for variation in network architecture and pretraining pipeline (algorithm and dataset). This reveals how well models with different pretrained backbones generalise to data of a somewhat different distribution to the training data, which will likely arise in deployment due to different cameras and demographics of patients, amongst other factors. We observe that the previous findings, regarding pretraining pipelines for polyp segmentation, hold true when considering generalisability. However, our results imply that models with ResNet50 backbones typically generalise better, despite being outperformed by models with ViT-B backbones in evaluation on the test set from the same dataset used for fine-tuning.
format Preprint
id arxiv_https___arxiv_org_abs_2405_15524
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Polyp Segmentation Generalisability of Pretrained Backbones
Sanderson, Edward
Matuszewski, Bogdan J.
Computer Vision and Pattern Recognition
Machine Learning
It has recently been demonstrated that pretraining backbones in a self-supervised manner generally provides better fine-tuned polyp segmentation performance, and that models with ViT-B backbones typically perform better than models with ResNet50 backbones. In this paper, we extend this recent work to consider generalisability. I.e., we assess the performance of models on a different dataset to that used for fine-tuning, accounting for variation in network architecture and pretraining pipeline (algorithm and dataset). This reveals how well models with different pretrained backbones generalise to data of a somewhat different distribution to the training data, which will likely arise in deployment due to different cameras and demographics of patients, amongst other factors. We observe that the previous findings, regarding pretraining pipelines for polyp segmentation, hold true when considering generalisability. However, our results imply that models with ResNet50 backbones typically generalise better, despite being outperformed by models with ViT-B backbones in evaluation on the test set from the same dataset used for fine-tuning.
title Polyp Segmentation Generalisability of Pretrained Backbones
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2405.15524