Learning to Upscale 3D Segmentations in Neuroimaging

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hu, Xiaoling, Liu, Peirong, Zemlyanker, Dina, Ramirez, Jonathan Williams, Puonti, Oula, Iglesias, Juan Eugenio
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912723712868352
author Hu, Xiaoling
Liu, Peirong
Zemlyanker, Dina
Ramirez, Jonathan Williams
Puonti, Oula
Iglesias, Juan Eugenio
author_facet Hu, Xiaoling
Liu, Peirong
Zemlyanker, Dina
Ramirez, Jonathan Williams
Puonti, Oula
Iglesias, Juan Eugenio
contents Obtaining high-resolution (HR) segmentations from coarse annotations is a pervasive challenge in computer vision. Applications include inferring pixel-level segmentations from token-level labels in vision transformers, upsampling coarse masks to full resolution, and transferring annotations from legacy low-resolution (LR) datasets to modern HR imagery. These challenges are especially acute in 3D neuroimaging, where manual labeling is costly and resolutions continually increase. We propose a scalable framework that generalizes across resolutions and domains by regressing signed distance maps, enabling smooth, boundary-aware supervision. Crucially, our model predicts one class at a time, which substantially reduces memory usage during training and inference (critical for large 3D volumes) and naturally supports generalization to unseen classes. Generalization is further improved through training on synthetic, domain-randomized data. We validate our approach on ultra-high-resolution (UHR) human brain MRI (~100 μm), where most existing methods operate at 1 mm resolution. Our framework effectively upsamples such standard-resolution segmentations to UHR detail. Results on synthetic and real data demonstrate superior scalability and generalization compared to conventional segmentation methods. Code is available at: https://github.com/HuXiaoling/Learn2Upscale.
format Preprint
id arxiv_https___arxiv_org_abs_2505_21697
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning to Upscale 3D Segmentations in Neuroimaging
Hu, Xiaoling
Liu, Peirong
Zemlyanker, Dina
Ramirez, Jonathan Williams
Puonti, Oula
Iglesias, Juan Eugenio
Computer Vision and Pattern Recognition
Obtaining high-resolution (HR) segmentations from coarse annotations is a pervasive challenge in computer vision. Applications include inferring pixel-level segmentations from token-level labels in vision transformers, upsampling coarse masks to full resolution, and transferring annotations from legacy low-resolution (LR) datasets to modern HR imagery. These challenges are especially acute in 3D neuroimaging, where manual labeling is costly and resolutions continually increase. We propose a scalable framework that generalizes across resolutions and domains by regressing signed distance maps, enabling smooth, boundary-aware supervision. Crucially, our model predicts one class at a time, which substantially reduces memory usage during training and inference (critical for large 3D volumes) and naturally supports generalization to unseen classes. Generalization is further improved through training on synthetic, domain-randomized data. We validate our approach on ultra-high-resolution (UHR) human brain MRI (~100 μm), where most existing methods operate at 1 mm resolution. Our framework effectively upsamples such standard-resolution segmentations to UHR detail. Results on synthetic and real data demonstrate superior scalability and generalization compared to conventional segmentation methods. Code is available at: https://github.com/HuXiaoling/Learn2Upscale.
title Learning to Upscale 3D Segmentations in Neuroimaging
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.21697