Pruning Unrolled Networks (PUN) at Initialization for MRI Reconstruction Improves Generalization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liang, Shijun, Bell, Evan, Ghosh, Avrajit, Ravishankar, Saiprasad
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910762352508928
author Liang, Shijun
Bell, Evan
Ghosh, Avrajit
Ravishankar, Saiprasad
author_facet Liang, Shijun
Bell, Evan
Ghosh, Avrajit
Ravishankar, Saiprasad
contents Deep learning methods are highly effective for many image reconstruction tasks. However, the performance of supervised learned models can degrade when applied to distinct experimental settings at test time or in the presence of distribution shifts. In this study, we demonstrate that pruning deep image reconstruction networks at training time can improve their robustness to distribution shifts. In particular, we consider unrolled reconstruction architectures for accelerated magnetic resonance imaging and introduce a method for pruning unrolled networks (PUN) at initialization. Our experiments demonstrate that when compared to traditional dense networks, PUN offers improved generalization across a variety of experimental settings and even slight performance gains on in-distribution data.
format Preprint
id arxiv_https___arxiv_org_abs_2412_18668
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Pruning Unrolled Networks (PUN) at Initialization for MRI Reconstruction Improves Generalization
Liang, Shijun
Bell, Evan
Ghosh, Avrajit
Ravishankar, Saiprasad
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Deep learning methods are highly effective for many image reconstruction tasks. However, the performance of supervised learned models can degrade when applied to distinct experimental settings at test time or in the presence of distribution shifts. In this study, we demonstrate that pruning deep image reconstruction networks at training time can improve their robustness to distribution shifts. In particular, we consider unrolled reconstruction architectures for accelerated magnetic resonance imaging and introduce a method for pruning unrolled networks (PUN) at initialization. Our experiments demonstrate that when compared to traditional dense networks, PUN offers improved generalization across a variety of experimental settings and even slight performance gains on in-distribution data.
title Pruning Unrolled Networks (PUN) at Initialization for MRI Reconstruction Improves Generalization
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2412.18668