Open-source framework for detecting bias and overfitting for large pathology images
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912257176240128 |
|---|---|
| author | Sildnes, Anders Shvetsov, Nikita Tafavvoghi, Masoud Tran, Vi Ngoc-Nha Møllersen, Kajsa Busund, Lill-Tove Rasmussen Kilvær, Thomas K. Bongo, Lars Ailo |
| author_facet | Sildnes, Anders Shvetsov, Nikita Tafavvoghi, Masoud Tran, Vi Ngoc-Nha Møllersen, Kajsa Busund, Lill-Tove Rasmussen Kilvær, Thomas K. Bongo, Lars Ailo |
| contents | Even foundational models that are trained on datasets with billions of data samples may develop shortcuts that lead to overfitting and bias. Shortcuts are non-relevant patterns in data, such as the background color or color intensity. So, to ensure the robustness of deep learning applications, there is a need for methods to detect and remove such shortcuts. Today's model debugging methods are time consuming since they often require customization to fit for a given model architecture in a specific domain. We propose a generalized, model-agnostic framework to debug deep learning models. We focus on the domain of histopathology, which has very large images that require large models - and therefore large computation resources. It can be run on a workstation with a commodity GPU. We demonstrate that our framework can replicate non-image shortcuts that have been found in previous work for self-supervised learning models, and we also identify possible shortcuts in a foundation model. Our easy to use tests contribute to the development of more reliable, accurate, and generalizable models for WSI analysis. Our framework is available as an open-source tool available on github. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01827 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Open-source framework for detecting bias and overfitting for large pathology images Sildnes, Anders Shvetsov, Nikita Tafavvoghi, Masoud Tran, Vi Ngoc-Nha Møllersen, Kajsa Busund, Lill-Tove Rasmussen Kilvær, Thomas K. Bongo, Lars Ailo Machine Learning Software Engineering Image and Video Processing Even foundational models that are trained on datasets with billions of data samples may develop shortcuts that lead to overfitting and bias. Shortcuts are non-relevant patterns in data, such as the background color or color intensity. So, to ensure the robustness of deep learning applications, there is a need for methods to detect and remove such shortcuts. Today's model debugging methods are time consuming since they often require customization to fit for a given model architecture in a specific domain. We propose a generalized, model-agnostic framework to debug deep learning models. We focus on the domain of histopathology, which has very large images that require large models - and therefore large computation resources. It can be run on a workstation with a commodity GPU. We demonstrate that our framework can replicate non-image shortcuts that have been found in previous work for self-supervised learning models, and we also identify possible shortcuts in a foundation model. Our easy to use tests contribute to the development of more reliable, accurate, and generalizable models for WSI analysis. Our framework is available as an open-source tool available on github. |
| title | Open-source framework for detecting bias and overfitting for large pathology images |
| topic | Machine Learning Software Engineering Image and Video Processing |
| url | https://arxiv.org/abs/2503.01827 |