Universal computational thermal imaging overcoming the ghosting effect

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xu, Hongyi, Wang, Du, Zhao, Chenjun, Chen, Jiashuo, Lin, Jiale, Cao, Liqin, Zhong, Yanfei, She, Yiyuan, Bao, Fanglin
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917380017356800
author Xu, Hongyi
Wang, Du
Zhao, Chenjun
Chen, Jiashuo
Lin, Jiale
Cao, Liqin
Zhong, Yanfei
She, Yiyuan
Bao, Fanglin
author_facet Xu, Hongyi
Wang, Du
Zhao, Chenjun
Chen, Jiashuo
Lin, Jiale
Cao, Liqin
Zhong, Yanfei
She, Yiyuan
Bao, Fanglin
contents Thermal imaging is crucial for night vision but fundamentally hampered by the ghosting effect, a loss of detailed texture in cluttered photon streams. While conventional ghosting mitigation has relied on data post-processing, the recent breakthrough in heat-assisted detection and ranging (HADAR) opens a promising frontier for hyperspectral computational thermal imaging that produces night vision with day-like visibility. However, universal anti-ghosting imaging remains elusive, as state-of-the-art HADAR applies only to limited scenes with uniform materials, whereas material non-uniformity is ubiquitous in the real world. Here, we propose a universal computational thermal imaging framework, TAG (thermal anti-ghosting), to address material non-uniformity and overcome ghosting for high-fidelity night vision. TAG takes hyperspectral photon streams for nonparametric texture recovery, enabling our experimental demonstration of unprecedented expression recovery in thus-far-elusive ghostly human faces -- the archetypal, long-recognized ghosting phenomenon. Strikingly, TAG not only universally outperforms HADAR across various scenes, but also reveals the influence of material non-uniformity, shedding light on HADAR's effectiveness boundary. We extensively test facial texture and expression recovery across day and night, and demonstrate, for the first time, thermal 3D topological alignment and mood detection. This work establishes a universal foundation for high-fidelity computational night vision, with potential applications in autonomous navigation, reconnaissance, healthcare, and wildlife monitoring.
format Preprint
id arxiv_https___arxiv_org_abs_2604_01542
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Universal computational thermal imaging overcoming the ghosting effect
Xu, Hongyi
Wang, Du
Zhao, Chenjun
Chen, Jiashuo
Lin, Jiale
Cao, Liqin
Zhong, Yanfei
She, Yiyuan
Bao, Fanglin
Computer Vision and Pattern Recognition
Optics
Thermal imaging is crucial for night vision but fundamentally hampered by the ghosting effect, a loss of detailed texture in cluttered photon streams. While conventional ghosting mitigation has relied on data post-processing, the recent breakthrough in heat-assisted detection and ranging (HADAR) opens a promising frontier for hyperspectral computational thermal imaging that produces night vision with day-like visibility. However, universal anti-ghosting imaging remains elusive, as state-of-the-art HADAR applies only to limited scenes with uniform materials, whereas material non-uniformity is ubiquitous in the real world. Here, we propose a universal computational thermal imaging framework, TAG (thermal anti-ghosting), to address material non-uniformity and overcome ghosting for high-fidelity night vision. TAG takes hyperspectral photon streams for nonparametric texture recovery, enabling our experimental demonstration of unprecedented expression recovery in thus-far-elusive ghostly human faces -- the archetypal, long-recognized ghosting phenomenon. Strikingly, TAG not only universally outperforms HADAR across various scenes, but also reveals the influence of material non-uniformity, shedding light on HADAR's effectiveness boundary. We extensively test facial texture and expression recovery across day and night, and demonstrate, for the first time, thermal 3D topological alignment and mood detection. This work establishes a universal foundation for high-fidelity computational night vision, with potential applications in autonomous navigation, reconnaissance, healthcare, and wildlife monitoring.
title Universal computational thermal imaging overcoming the ghosting effect
topic Computer Vision and Pattern Recognition
Optics
url https://arxiv.org/abs/2604.01542