Uncertainty modeling for fine-tuned implicit functions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Susmelj, Anna, Macuglia, Mael, Tagasovska, Nataša, Sutter, Reto, Caprara, Sebastiano, Thiran, Jean-Philippe, Konukoglu, Ender
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908276363362304
author Susmelj, Anna
Macuglia, Mael
Tagasovska, Nataša
Sutter, Reto
Caprara, Sebastiano
Thiran, Jean-Philippe
Konukoglu, Ender
author_facet Susmelj, Anna
Macuglia, Mael
Tagasovska, Nataša
Sutter, Reto
Caprara, Sebastiano
Thiran, Jean-Philippe
Konukoglu, Ender
contents Implicit functions such as Neural Radiance Fields (NeRFs), occupancy networks, and signed distance functions (SDFs) have become pivotal in computer vision for reconstructing detailed object shapes from sparse views. Achieving optimal performance with these models can be challenging due to the extreme sparsity of inputs and distribution shifts induced by data corruptions. To this end, large, noise-free synthetic datasets can serve as shape priors to help models fill in gaps, but the resulting reconstructions must be approached with caution. Uncertainty estimation is crucial for assessing the quality of these reconstructions, particularly in identifying areas where the model is uncertain about the parts it has inferred from the prior. In this paper, we introduce Dropsembles, a novel method for uncertainty estimation in tuned implicit functions. We demonstrate the efficacy of our approach through a series of experiments, starting with toy examples and progressing to a real-world scenario. Specifically, we train a Convolutional Occupancy Network on synthetic anatomical data and test it on low-resolution MRI segmentations of the lumbar spine. Our results show that Dropsembles achieve the accuracy and calibration levels of deep ensembles but with significantly less computational cost.
format Preprint
id arxiv_https___arxiv_org_abs_2406_12082
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Uncertainty modeling for fine-tuned implicit functions
Susmelj, Anna
Macuglia, Mael
Tagasovska, Nataša
Sutter, Reto
Caprara, Sebastiano
Thiran, Jean-Philippe
Konukoglu, Ender
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Implicit functions such as Neural Radiance Fields (NeRFs), occupancy networks, and signed distance functions (SDFs) have become pivotal in computer vision for reconstructing detailed object shapes from sparse views. Achieving optimal performance with these models can be challenging due to the extreme sparsity of inputs and distribution shifts induced by data corruptions. To this end, large, noise-free synthetic datasets can serve as shape priors to help models fill in gaps, but the resulting reconstructions must be approached with caution. Uncertainty estimation is crucial for assessing the quality of these reconstructions, particularly in identifying areas where the model is uncertain about the parts it has inferred from the prior. In this paper, we introduce Dropsembles, a novel method for uncertainty estimation in tuned implicit functions. We demonstrate the efficacy of our approach through a series of experiments, starting with toy examples and progressing to a real-world scenario. Specifically, we train a Convolutional Occupancy Network on synthetic anatomical data and test it on low-resolution MRI segmentations of the lumbar spine. Our results show that Dropsembles achieve the accuracy and calibration levels of deep ensembles but with significantly less computational cost.
title Uncertainty modeling for fine-tuned implicit functions
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2406.12082