Hyperspectral Image Restoration and Super-resolution with Physics-Aware Deep Learning for Biomedical Applications
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917946258882560 |
|---|---|
| author | Xiang, Yuchen Liu, Zhaolu Garcia-Segura, Monica Emili Simon, Daniel Cao, Boxuan Wu, Vincen Robinson, Kenneth Wang, Yu Battle, Ronan Murray, Robert T. Altafaj, Xavier Peruzzotti-Jametti, Luca Takats, Zoltan |
| author_facet | Xiang, Yuchen Liu, Zhaolu Garcia-Segura, Monica Emili Simon, Daniel Cao, Boxuan Wu, Vincen Robinson, Kenneth Wang, Yu Battle, Ronan Murray, Robert T. Altafaj, Xavier Peruzzotti-Jametti, Luca Takats, Zoltan |
| contents | Hyperspectral imaging is a powerful bioimaging tool which can uncover novel insights, thanks to its sensitivity to the intrinsic properties of materials. However, this enhanced contrast comes at the cost of system complexity, constrained by an inherent trade-off between spatial resolution, spectral resolution, and imaging speed. To overcome this limitation, we present a deep learning-based approach that restores and enhances pixel resolution post-acquisition without any a priori knowledge. Fine-tuned using metrics aligned with the imaging model, our physics-aware method achieves a 16X pixel super-resolution enhancement and a 12X imaging speedup without the need of additional training data for transfer learning. Applied to both synthetic and experimental data from five different sample types, we demonstrate that the model preserves biological integrity, ensuring no features are lost or hallucinated. We also concretely demonstrate the model's ability to reveal disease-associated metabolic changes in Downs syndrome that would otherwise remain undetectable. Furthermore, we provide physical insights into the inner workings of the model, paving the way for future refinements that could potentially surpass instrumental limits in an explainable manner. All methods are available as open-source software on GitHub. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_02908 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Hyperspectral Image Restoration and Super-resolution with Physics-Aware Deep Learning for Biomedical Applications Xiang, Yuchen Liu, Zhaolu Garcia-Segura, Monica Emili Simon, Daniel Cao, Boxuan Wu, Vincen Robinson, Kenneth Wang, Yu Battle, Ronan Murray, Robert T. Altafaj, Xavier Peruzzotti-Jametti, Luca Takats, Zoltan Image and Video Processing Computer Vision and Pattern Recognition Hyperspectral imaging is a powerful bioimaging tool which can uncover novel insights, thanks to its sensitivity to the intrinsic properties of materials. However, this enhanced contrast comes at the cost of system complexity, constrained by an inherent trade-off between spatial resolution, spectral resolution, and imaging speed. To overcome this limitation, we present a deep learning-based approach that restores and enhances pixel resolution post-acquisition without any a priori knowledge. Fine-tuned using metrics aligned with the imaging model, our physics-aware method achieves a 16X pixel super-resolution enhancement and a 12X imaging speedup without the need of additional training data for transfer learning. Applied to both synthetic and experimental data from five different sample types, we demonstrate that the model preserves biological integrity, ensuring no features are lost or hallucinated. We also concretely demonstrate the model's ability to reveal disease-associated metabolic changes in Downs syndrome that would otherwise remain undetectable. Furthermore, we provide physical insights into the inner workings of the model, paving the way for future refinements that could potentially surpass instrumental limits in an explainable manner. All methods are available as open-source software on GitHub. |
| title | Hyperspectral Image Restoration and Super-resolution with Physics-Aware Deep Learning for Biomedical Applications |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.02908 |