FusionRegister: Every Infrared and Visible Image Fusion Deserves Registration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bian, Congcong, Ma, Haolong, Li, Hui, Shen, Zhongwei, Luo, Xiaoqing, Song, Xiaoning, Wu, Xiao-Jun
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914378712875008
author Bian, Congcong
Ma, Haolong
Li, Hui
Shen, Zhongwei
Luo, Xiaoqing
Song, Xiaoning
Wu, Xiao-Jun
author_facet Bian, Congcong
Ma, Haolong
Li, Hui
Shen, Zhongwei
Luo, Xiaoqing
Song, Xiaoning
Wu, Xiao-Jun
contents Spatial registration across different visual modalities is a critical but formidable step in multi-modality image fusion for real-world perception. Although several methods are proposed to address this issue, the existing registration-based fusion methods typically require extensive pre-registration operations, limiting their efficiency. To overcome these limitations, a general cross-modality registration method guided by visual priors is proposed for infrared and visible image fusion task, termed FusionRegister. Firstly, FusionRegister achieves robustness by learning cross-modality misregistration representations rather than forcing alignment of all differences, ensuring stable outputs even under challenging input conditions. Moreover, FusionRegister demonstrates strong generality by operating directly on fused results, where misregistration is explicitly represented and effectively handled, enabling seamless integration with diverse fusion methods while preserving their intrinsic properties. In addition, its efficiency is further enhanced by serving the backbone fusion method as a natural visual prior provider, which guides the registration process to focus only on mismatch regions, thereby avoiding redundant operations. Extensive experiments on three datasets demonstrate that FusionRegister not only inherits the fusion quality of state-of-the-art methods, but also delivers superior detail alignment and robustness, making it highly suitable for infrared and visible image fusion method. The code will be available at https://github.com/bociic/FusionRegister.
format Preprint
id arxiv_https___arxiv_org_abs_2603_07667
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FusionRegister: Every Infrared and Visible Image Fusion Deserves Registration
Bian, Congcong
Ma, Haolong
Li, Hui
Shen, Zhongwei
Luo, Xiaoqing
Song, Xiaoning
Wu, Xiao-Jun
Computer Vision and Pattern Recognition
Spatial registration across different visual modalities is a critical but formidable step in multi-modality image fusion for real-world perception. Although several methods are proposed to address this issue, the existing registration-based fusion methods typically require extensive pre-registration operations, limiting their efficiency. To overcome these limitations, a general cross-modality registration method guided by visual priors is proposed for infrared and visible image fusion task, termed FusionRegister. Firstly, FusionRegister achieves robustness by learning cross-modality misregistration representations rather than forcing alignment of all differences, ensuring stable outputs even under challenging input conditions. Moreover, FusionRegister demonstrates strong generality by operating directly on fused results, where misregistration is explicitly represented and effectively handled, enabling seamless integration with diverse fusion methods while preserving their intrinsic properties. In addition, its efficiency is further enhanced by serving the backbone fusion method as a natural visual prior provider, which guides the registration process to focus only on mismatch regions, thereby avoiding redundant operations. Extensive experiments on three datasets demonstrate that FusionRegister not only inherits the fusion quality of state-of-the-art methods, but also delivers superior detail alignment and robustness, making it highly suitable for infrared and visible image fusion method. The code will be available at https://github.com/bociic/FusionRegister.
title FusionRegister: Every Infrared and Visible Image Fusion Deserves Registration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.07667