Semantic Correspondence: Unified Benchmarking and a Strong Baseline

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Kaiyan, Li, Xinghui, Lu, Jingyi, Han, Kai
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908381166436352
author Zhang, Kaiyan
Li, Xinghui
Lu, Jingyi
Han, Kai
author_facet Zhang, Kaiyan
Li, Xinghui
Lu, Jingyi
Han, Kai
contents Establishing semantic correspondence is a challenging task in computer vision, aiming to match keypoints with the same semantic information across different images. Benefiting from the rapid development of deep learning, remarkable progress has been made over the past decade. However, a comprehensive review and analysis of this task remains absent. In this paper, we present the first extensive survey of semantic correspondence methods. We first propose a taxonomy to classify existing methods based on the type of their method designs. These methods are then categorized accordingly, and we provide a detailed analysis of each approach. Furthermore, we aggregate and summarize the results of methods in literature across various benchmarks into a unified comparative table, with detailed configurations to highlight performance variations. Additionally, to provide a detailed understanding on existing methods for semantic matching, we thoroughly conduct controlled experiments to analyse the effectiveness of the components of different methods. Finally, we propose a simple yet effective baseline that achieves state-of-the-art performance on multiple benchmarks, providing a solid foundation for future research in this field. We hope this survey serves as a comprehensive reference and consolidated baseline for future development. Code is publicly available at: https://github.com/Visual-AI/Semantic-Correspondence.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18060
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Semantic Correspondence: Unified Benchmarking and a Strong Baseline
Zhang, Kaiyan
Li, Xinghui
Lu, Jingyi
Han, Kai
Computer Vision and Pattern Recognition
Establishing semantic correspondence is a challenging task in computer vision, aiming to match keypoints with the same semantic information across different images. Benefiting from the rapid development of deep learning, remarkable progress has been made over the past decade. However, a comprehensive review and analysis of this task remains absent. In this paper, we present the first extensive survey of semantic correspondence methods. We first propose a taxonomy to classify existing methods based on the type of their method designs. These methods are then categorized accordingly, and we provide a detailed analysis of each approach. Furthermore, we aggregate and summarize the results of methods in literature across various benchmarks into a unified comparative table, with detailed configurations to highlight performance variations. Additionally, to provide a detailed understanding on existing methods for semantic matching, we thoroughly conduct controlled experiments to analyse the effectiveness of the components of different methods. Finally, we propose a simple yet effective baseline that achieves state-of-the-art performance on multiple benchmarks, providing a solid foundation for future research in this field. We hope this survey serves as a comprehensive reference and consolidated baseline for future development. Code is publicly available at: https://github.com/Visual-AI/Semantic-Correspondence.
title Semantic Correspondence: Unified Benchmarking and a Strong Baseline
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.18060