Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Shihua, Li, Zizhuo, Zhang, Kaining, Lu, Yifan, Deng, Yuxin, Tang, Linfeng, Jiang, Xingyu, Ma, Jiayi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2506.04619
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910989143769088
author Zhang, Shihua
Li, Zizhuo
Zhang, Kaining
Lu, Yifan
Deng, Yuxin
Tang, Linfeng
Jiang, Xingyu
Ma, Jiayi
author_facet Zhang, Shihua
Li, Zizhuo
Zhang, Kaining
Lu, Yifan
Deng, Yuxin
Tang, Linfeng
Jiang, Xingyu
Ma, Jiayi
contents Image matching, which establishes correspondences between two-view images to recover 3D structure and camera geometry, serves as a cornerstone in computer vision and underpins a wide range of applications, including visual localization, 3D reconstruction, and simultaneous localization and mapping (SLAM). Traditional pipelines composed of ``detector-descriptor, feature matcher, outlier filter, and geometric estimator'' falter in challenging scenarios. Recent deep-learning advances have significantly boosted both robustness and accuracy. This survey adopts a unique perspective by comprehensively reviewing how deep learning has incrementally transformed the classical image matching pipeline. Our taxonomy highly aligns with the traditional pipeline in two key aspects: i) the replacement of individual steps in the traditional pipeline with learnable alternatives, including learnable detector-descriptor, outlier filter, and geometric estimator; and ii) the merging of multiple steps into end-to-end learnable modules, encompassing middle-end sparse matcher, end-to-end semi-dense/dense matcher, and pose regressor. We first examine the design principles, advantages, and limitations of both aspects, and then benchmark representative methods on relative pose recovery, homography estimation, and visual localization tasks. Finally, we discuss open challenges and outline promising directions for future research. By systematically categorizing and evaluating deep learning-driven strategies, this survey offers a clear overview of the evolving image matching landscape and highlights key avenues for further innovation.
format Preprint
id arxiv_https___arxiv_org_abs_2506_04619
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deep Learning Reforms Image Matching: A Survey and Outlook
Zhang, Shihua
Li, Zizhuo
Zhang, Kaining
Lu, Yifan
Deng, Yuxin
Tang, Linfeng
Jiang, Xingyu
Ma, Jiayi
Computer Vision and Pattern Recognition
Image matching, which establishes correspondences between two-view images to recover 3D structure and camera geometry, serves as a cornerstone in computer vision and underpins a wide range of applications, including visual localization, 3D reconstruction, and simultaneous localization and mapping (SLAM). Traditional pipelines composed of ``detector-descriptor, feature matcher, outlier filter, and geometric estimator'' falter in challenging scenarios. Recent deep-learning advances have significantly boosted both robustness and accuracy. This survey adopts a unique perspective by comprehensively reviewing how deep learning has incrementally transformed the classical image matching pipeline. Our taxonomy highly aligns with the traditional pipeline in two key aspects: i) the replacement of individual steps in the traditional pipeline with learnable alternatives, including learnable detector-descriptor, outlier filter, and geometric estimator; and ii) the merging of multiple steps into end-to-end learnable modules, encompassing middle-end sparse matcher, end-to-end semi-dense/dense matcher, and pose regressor. We first examine the design principles, advantages, and limitations of both aspects, and then benchmark representative methods on relative pose recovery, homography estimation, and visual localization tasks. Finally, we discuss open challenges and outline promising directions for future research. By systematically categorizing and evaluating deep learning-driven strategies, this survey offers a clear overview of the evolving image matching landscape and highlights key avenues for further innovation.
title Deep Learning Reforms Image Matching: A Survey and Outlook
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.04619